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ABSTRACT 

Since 1992, the New American Schools Development 
Corporation (NASDC) has supported nine teams that developed designs 
for high-performance schools. This workbook is a guide developed for 
NASDC and for school-based reformers. It presents a framework for 
student and program evaluation called progress assessment. Chapters 2 
through 5 provide suggestions, examples, and worksheets for 
evaluating school-reform programs. The progress-assessment framework 
is comprised of three steps: (1) specify program goals; (2) designate 
indicators of school change and program impact; and (3) define 
methods for data collection and analysis. Chapter 6 offers a template 
for developing school-reform portfolios, which promote accountability 
and continuous school improvement. The template has five sections: a 
statement of the school's vision and reform objectives; a description 
of the student population, school, and community; descriptions of 
initial implementation levels, early outcomes, and subsequent 
performance indicators; a summary of reform progress and challenges; 
and appendices that display supporting data. Three figures and three 
tables are included. The appendix contains the George Washington New 
American School portfolio for 1993-94. Contains 18 references. 
(LMI) 
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PREFACE 



CREA.1IXNS NEW AMERICAN SCHOOLS 

In July 1991 at the behest of President George Bush, American 
corporate and foundation leaders launched the New American Schools 
Development Corporation (NASDC) to promote urgently needed change in our 
nation's public education system. NASDC supports nine Design Teams who 
have developed and are implementing comprehensive designs for high- 
performance schools. President Bill Clinton strongly endorses NASDC and 
the Design Teams' work. 

NASDC believes that schools and students should not be treated as 
assembly-line products. The nine designs represent unique philosophies 
and varied, but proven education practices . Further, these designs are 
responsive to the needs, values, interests, and capabilities of the 
schools and communities they serve. However, unifying NASDC' s diverse 
designs is a firm set of essential principals; these, in NASDC s view, 
are the building blocks of whole-school reform: 

• High academic standards 

• Strong and fair accountability and assessment measures 
Curricular and instructional strategies that include thematic, 
project-based, and interactive learning 

• Continuous professional development for teachers and staff 

• Service to, and strong support from, parents and the community 

• School autonomy and decentralized governance structures for 
more efficient operations 

• Integrated use of technology to enhance the performance of 
students, teachers and schools 

NASDC Design Teams soon will be working in selected jurisdictions 
to help states and districts create transformed schools. As schools in 
these jurisdictions begin their work, NASDC reasserts its commitment to 
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accountability and to strong and fair assessment — for students and 
schools. 

This guide was developed by RAND for NASDC and those propelling 
NASDC and other design-based transformations. It rests on the reform 
expertise of school-level participants; the discussion is aimed at 
reformers who want to know more about assessing their progress. 
Charting Progress is designed to help school-based reformers examine 
their work, create longitudinal records of progress, and drive 
continuing program improvement. The school portfolios that result will 
provide a wealth of information for teachers interested in iitproving 
their practice, for school administrators and parents striving for 
better schools, and for business and community leaders committed to 
supporting strong school programs. This workbook is a tool for 
assessing and portraying school transformation. 
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SUMMARY 



Those who seek to reform schools -- teachers and school-building 
staff, administrators, and funders -- inevitably face the difficult 
dilemma of dem.onstrating to skeptical parents, community members, and 
boards that the reform is proceeding well and that student performance 
is improving. Pressures to evaluate a reform effort are nearly 
immediate, despite the fact that most agree school transformation is 
time-consmning. Mandated assessments that are components of state or 
district accountability systems often provide what is taken to be an 
evaluation, but such assessments frequently are poorly aligned to the 
intent of the reform and premature in their timing. More than one 
reform effort has been derailed by either such premature, mis-aligned 
assessment or by a failure of reformers to take seriously the need to 
portray the progress that reform efforts are making. 

The Nev/ American Schools Development Corporation (NASDC) has faced 
this difficulty. For the past three years, it has supported nine teams 
who are developing designs for high performance schools. On the whole, 
these designs involve curriculum, pedagogy, school organization, and 
management practices that differ from what is commonly found in the 
nation's schools. Each has been in a state of development, so that 
during the past several years it has been difficult to identify stable 
elements of schooling that could be assessed. Yet, quite reasonably, 
potential adopters of these designs are anxious to know whether they 
"work . " 

RAND, which is responsible for assessment for NASDC, has wrestled 
with this dilemma. It has sought a means of assessing the progress that 
a school site is making, a vehicle that would provide a meaningful 
statement to the wide variety of parties to the reform. It also has 
sought to create an assessm.ent procedure that would support the school 
itself in reform. Our proposed solution takes the form of a framework 
for a portfolio that would be prepared and maintained by the school. 
This report provides the initial specifications (in the form of a 
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workbook) for such a portfolio and illustrates these specifications with 
examples from the NASDC design efforts. 

The first level objective of the workbook is to help whole-school 
reformers marry the work of reform with the analysis of change. Again, 
it presents a framework for assessing and portraying school 
transformation. The framework is directed at helping school-level 
reformers examine their work, create longitudinal records of progress, 
and drive continuing program improvement. The school reform portfolios 
thus created additionally provide a form of accountability to the 
community, administrative elites, and funders. Over time RAND hopes the 
portfolios can be analyzed collectively to provide a rich assessment of 
the overall NASDC -supported effort. 

We term the student and program evaluation framework outlined, 
here, progress assessment. The assessment assumes the school has at 
least some sense of the goals that it seeks and the means by which these 
goals will be achieved. In the case of NASDC 's designs, these goals and 
means are either a part of the design specification or generated in the 
early processes that the design teams suggest. For other reform 
efforts, they would be the products of the early planning a school goes 
through as it decides on a reform path. Given these, progress 
assessment poses questions that school-based reformers undoubtedly ask 
themselves as they go about their work and seek to improve their 
programs. These questions include: 

• Are program elements being implemented and are they observable 
in the school? 

• Are participants (students, teachers, parents, administrators) 
making progress in relation to the program's goals? 

• Which activities and strategies are aiding participants' 
progress toward reform goals? 

• Which activities and strategies are impeding progress toward 
program goals? 

• Are students and adult participants benefiting from program 
activities and strategies? 
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• What do progress levels (and aids and impediments) suggest 
about upcoming work and continuing program improvement? 

This workbook consists of two components. The first provides 
suggestions, examples, and worksheets for use in assessing progress; 
the second offers a template for developing school reform portfolios. 
The framework for assessing progress supports reformers in engaging 
stakeholders in all stages of the progress assessment. 

Progress Assessment 

The workbook walks reformers through three steps: it talks about 
specifying program goals, designating progress indicators and 
benchmarks, and planning data collections and suinmaries. The first step 
asks reformers to lay out statements of their reform goals and 
objectives. It instructs them to specify objectives in major program 
areas, including for example, standards and assessment, curriculum and 
instruction, school organization, teacher professional development, 
technology use, school governance, family and community services, public 
engagement, and school/system/designer partnering. Reformers also are 
asked to state their broad aims for improving student performance and 
strengthening school programs; these statements cut across program 
areas and speak to objectives such as, improving attendance levels, 
reducing drop-out rates, and broadening parent involvement. 

At step two for each objective, reformers are asked to specify 
indicators of school change and program impact. The workbook describes 
three categories of indicators: implementation observables, 
participants' judgments, and outcome indicators. 

• Implementation observables are observable manifestations of 
design components; they are things observers can see in the 
school building that suggest the program is initiated and on 
its way . 

• Students', teachers', administrators', parents', and designers' 
judgments also are important inputs for progress monitoring; 
student and adult participants can offer perspectives on, for 
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instance, design clarity; the quality of program guidance, 
resources and activities; and the presence of early (then 
ongoing) program benefits to students and others. 

• Outcome indicators speak to the direct impact of reformers' 
work; they talk about the impact of program efforts on 
students, teachers, and others and rely on measures, for 
example, of student performance, effective teaching practice, 
and family support. 

Step two additionally asks reformers to specify benchmarks for important 
indicators at key points in the program's life. 

Finally, step three calls on school-based reformers to define the 
means by which data will be gathered. It asks them to consider a mix of 
qualitative and quantitative approaches to information-gathering, 
including observables inventories, surveys, interviews, focus groups, 
student performance assessments, portfolios and projects, teacher logs, 
and/or progress rubrics. Descriptions and sample instruments appear in 
the workbook. Methods for examining and summarizing the data that 
result also are discussed. 

School Reform Portfolios 

The second part of this workbook provides a template for developing 
a school reform portfolio which is fundamentally a documentation of the 
progress assessment just outlined. The portfolio template has five 
sections; it includes: 

• A statement of the school's vision and objectives for reform, 

• A description of the student population, school and community, 

• Descriptions of initial implementation levels, early outcomes, 
and--over time--later indicators of progress and program 
effects, 

A sunimary of reform progress and challenges, with 
recommendations for future reform work, and 

Appendices, providing data displays to support the body of the 
portfolio . 

I u 
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As conceived here, the third section of the reform portf olio--the 
description of implementation levels and outcomes--provides three levels 
of information. The top level gives a short, directed portrayal of the 
most important information about implementation and outcomes. The 
second level gives a more extended, descriptive and qualified discussion 
of the data and their context. The third level includes case study 
inf I. rmation , narrative data, or sample materials to illustrate and make 
richer the information provided in the top level. In comparison to 
traditional evaluation reports, this format permits a more 
comprehensive, faithful portrayal of whole-school reform. A sample 
portfolio appears in Appendix A of the workbook. 

Conclusion 

The school reform portfolio is intended to serve several audiences 
and address varied objectives. At the local level, it will provide a 
vehicle for deliberation about school reform. The school portfolio will 
describe the work of participants at key points in time and set the 
agenda for ongoing school improvement. It is intended to support a 
process of continuous school iii5>rovement . The reform portfolio also 
will provide important accountability information to program 
stakeholders; it will document the extent to which expected progress 
and outcomes are attained. The school reform portfolio will record for 
participants and stakeholders alike things examined, refined, and 
learned. 

This workbook advances the notion that school reform portfolios 
will contribute to the evolving knowledge base about school-wide reform. 
For schools attempting to emulate reform programs, portfolios may 
provide guidance and, perhaps, suggest realistic expectations for the 
pace of school change. For funders of reform, portfolios may provide 
guidance for program development. For policy makers seeking to advance 
school transformation, reform portfolios may be useful in policy 
formulation. For researchers, collections of portfolios may provide 
valuable insight into the aids and barriers to school improvement 
inherent our current education system. 
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CBiUlTING THE PROGRESS OF NEW AMERICAN SCHOOLS 

This workbook is a guide developed for the New American Schools 
Development Corporation (NASDC) and for school-based reformers . It is 
designed to help whole-school reformers marry the work of reform with 
the analysis of change. This workbook presents a framework for 
assessing and portraying school transformation. The freunework is 
directed at helping school-level reformers examine their work, create 
longitudinal records of progress, and drive continuing program 
improvement . 

This guide offers suggestions, worksheets, and models for examining 
and documenting student and school progress. It presents a student and 
program evaluation framework called progress assessment. Additionally, 
it promotes school reform portfolios — as vehicles for monitoring and 
managing school transf oinnation, for accountability to stakeholders, and 
as a means of reporting to those sponsoring and committed to school 
reform. 

THE CONTEXT FOR PROGRESS ASSESSMENT 

Some of the data that progress assessment and reform portfolios 
draw on are coincident with those being collected in NASDC 
jurisd-ictions. These states and districts, like many others, gather data 
about student needs, school resources, student performance, and school 
performance; the data are collected to several ends. They, most simply, 
are used in administrative control of schools and systems. They also are 
used by jurisdictions to monitor student and school performance. They 
allow systems and the public to hold schools accountable for decisions 
made about teaching and learning and actions taken on behalf of 
students. These accountability judgments sometimes are supported by data 
on the performance of comparable or politically relevant groups. 
Sometimes they are linked to judgments about students' expected mastery 
of knowledge and skills. The beat statements about school 
effectiveness, however, reference schools' goals, relate observed 
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student and school performance to progress benchmarks, and feed data 
into local improvement plans. It is these conprehensive systems for 
indexing school iitprovement and accountability that progress assessment 
most closely mirrors. 

Progress assessment poses questions that school-based reformers ask 
themselves as they go about their work and seek to iirqprove their 
programs. These questions include: 

• • Are program elements being implemented and are they observable 
in the school? 

• Are participants (students, teachers, parents, administrators) 
making progress in relation to the program' s goals? 

• Which activities and strategies are aiding participants' 
progress toward reform goals? 

• Which activities and strategies are iitpeding progress toward 
program goals? 

• Are students and adult participants benefiting from program 
activities and strategies? 

• What do progress levels (and aids and impediments) suggest 
about upcoming work and continuing program improvement? 

These questions direct reformers' assessments of school progress. Their 
answers are the subjects of school reform portfolios. 

THE NEED FOR PRCXtRESS ASSESSMENT 

The progress assessment framework derives from the work of NASDC's 
partners and from RAND's observations of school change. It rests on the 
following assertions: 



At the heart of program iitprovement are efforts to track 
inplementation progress and examine outcomes. It is not 
unusual for school-based reformers to defer evaluation and 
focus their energies on development, initiation, and 
implementation. In the absence of early and deliberate 
attention to program assessment, however, baseline data and the 
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mechanisms for capturing relevant information over time are 
unlikely to be available. In their absence reformers will be 
handicapped in attempts to examine and speak crisply to 
progress. More importantly, they will be impaired in 
addressing challenges and recommending program in?>rovements . 

• It . is in?>ortant that participants and stakeholders hold common 
expectations for the work and progress of school reform. 
Reformers should offer participants and stakeholders an 
opportunity to debate where the program is going, how it is 
getting there, and how long it will take. By making explicit 
their hopes for the program, reformers help establish shared 
expectations for school progress and program outcomes. 

• The performance of transforming schools is most meaningfully 
assessed in relation to reform intents and design features. 
Evaluation plans should faithfully address reformers' goals; 
they should track the implementation of design components, the 
program's early outcomes, and — as the reform matures — more 
numerous and telling indicators of school progress and program 
effects . 

• The most telling descriptions of school progress are provided 
by broad, con^rehensive systems of indicators. Reformers should 
specify multiple and varied indicators of student progress and 
program effectiveness. Evaluation should elicit balanced 
information about students and the school — using metrics and 
criteria iit^ortant to participants and stakeholders. By making 
explicit the range of intended outcomes, reformers help thwart 
stakeholder attempts to hold up high student test scores as the 
only hallmarks of educational success. Reformers prepare the 
canvas for a more complete painting of school progress; the 
broad involvement of stakeholders offers assurance of a 
faithful rendering. 

i. 
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• It is essential that participants and stakeholders discuss the 
rate at which progress is expected. By specifying benchmarks 
for progress, reformers preview the milestones for change. 
Reformers can discuss the slow, often stop-and-go pace of 
school-wide change; they can alert participants and observers 
to the possible early dis -equilibrium of reform. These 
discussions promote shared expectations for the rate at which 
student success and program maturity likely will be observed. 

• Progress assessment and school reform portfolios provide 
important and necessary accountability information. In addition 
to their role in program iit^jrovement , progress assessment data 
ar6 important to numerous stakeholder audiences, including 
state and district staff, boards of education, parents, 
community members, funders and fellow reformers. They serve to 
document reformers' efforts; they record the extent to which 
expected progress and outcomes are attained. Progress data may 
help state and district sponsors as well as funders like NASDC, 
Annenberg and other reform-minded foundations and corporations 
(1) formulate policy to help transforming schools advance more 
quickly and effectively, and (2) present to the public the 
collective efforts, accoit^jlishments, and lessons of reforming 
schools . 

This framework asks reformers to chart their course to whole-school 
transformation. It asks stakeholders to engage in deliberation about 
the journey and destination. The New American Schools Reforra Portfolio 
records for participants and stakeholders alike things Citamined, 
refined, and learned. Portfolios describe the work of participants at 
key points in time and drive continuing program iit^jrovement . They 
portray initial implementation levels, early outcomes and — over time — 
later indicators of progress and program effects. They help establish 
the agenda for ongoing school improvement and promote fuller and 
continuing understanding of reform progress for present and future 
transforming schools. 
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The progress assessment framework and format of this guide are 
described next. 
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2. CHARITING SCHOOL PROGRESS 



PROGRESS ASSESSMENT 

The progress assessment framework was inspired by the NASDC 
experience. It speaks to the varied, but synergistic elements of whole- 
school reforms. This workbook is designed for those propelling NASDC 
and other design-based transformations. It relies on the reform 
expertise of school-level participants; the discussion is aimed at 
reformers who want to know more about assessing their progress. 

The progress assessment framework calls on school-based reformers 
to lay out and execute plans for assessing progress and develop reform 
portfolios to portray school transformation. In assessing progress, it 
asks reformers to: 

• Create shared expectations among participants and stakeholders 
for the program's goals, progression, and intended outcomes. 
Agree upon indicators and benchmarks for design implementation 
and program outcomes, 

• Gather information about students and their school prior to 
program irqplementation — as a baseline for assessing progress. 
Identify strategies for collecting on an ongoing basis varied 
and rich data about progress in relation to reform intents, 

• Specify data sources, data collection timelines, and mechanisms 
for managing early and ongoing data, and 

• Marshall and summarize quantitative and qualitative data about 
school transformation. 

In developing and using reform portfolios, the framework calls on 
school-based reformers to: 

• Create accounts of the most important and telling data about 
implementation and outcomes. 
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• Develop rich records of progress by illustrating student and 
program data with case study accounts, narrative data, and 
sample materials, 

• Create longitudinal records of student and program progress, 

• Identify progreim strengths and challenges, as well as, aides 
and barriers to reform, 

• Realign program goals and upcoming work where the data 
recommend it and, thereby, drive continuing program 
inprovement , 

• Provide inportant and necessary accountability information for 
participants and program stakeholders, and 

• Promote fuller and continuing understanding of reform progress 
for present and future transf oi:ming schools. 

WORKBOOK FORMAT 

This workbook has two parts. The first gives suggestions, examples, 
and worksheets for laying out goals, specifying progress indicators, and 
planning data collections and summaries. The second part provides a 
template for developing a New American Schools Reform Portfolio. 
Overviews of both conponents are given next; these are followed in 
Chapters 3 through 6 by detailed discussions of their elements. 

Assessing Progress 

The first part of the workbook provides tools designed to help 
users examine school progress. The suggestions and worksheets proiqpt 
reformers to address all design elements and marshall multiple and 
varied data. They are meant to encourage reformers to collect a rich 
mix of qualitative and quantitative information. Because lags in 
implementation and outcomes are a central fact of school-wide reform, 
the framework also pushes users to set realistic benchmarks for change. 
These tools are designed to support the observations and recommendations 
offered by school reform portfolios. 

This workbook walks reformers through three steps for charting 
progress. The first step asks reformers and school stakeholders to lay 
out statements of their reform goals and objectives. At step two for 
each objective, reformers are asked to specify indicators of school 
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change and effect. Additionally, the levels at which change is 
anticipated at important time intervals should be noted. Finally, step 
three calls on school -based reformers to describe the means by which 
data will be gathered; it discusses data collection, analysis and data 
reduction. Chapters 3 through 5 describe the three sets of activities. 

Portraying Progress — Creating a School Reform Portfolio 

The school reform portfolio provides a longitudinal record of 
progress in relation to reformers' benchmarks for progress; it describes 
the work of participants as reform progresses. On a continuing basis, it 
offers suggestions for realignment of upcoming goals and recommendations 
for future reform work. The portfolio template has five sections. 

So that the portfolio will stand on its own, the first section 
describes the design and school's vision for reform. The second section 
discuses school and community characteristics; the third portrays 
implementation levels, early and later outcomes for major program 
elements . As conceived here, the third section follows an information 
pyramid format. The top level of the pyramid gives a short, directed 
portrayal of the most interesting information about implementation and 
outcomes. The second level gives a more extended, descriptive and 
qualified discussion of the data and their context. The bottom level 
includes case study information, narrative data, or sample materials to 
illustrate and make richer the information provided in the top level. 

The data and obser^rations provided by the information pyramids will 
drive participants' recommendations for future work. These, along with 
the summaries of reform progress and challenges, appear in the fourth 
section of the portfolio. The final section includes data displays to 
support information given in the body of the document. 

The five parts of the reform portfolios are discussed in Chapter 6 
of this workbook. A sample portfolio, showing all five sections, appears 
in Appendix A. Readers may find it helpful to take an early look at the 
sample portfolio. The progress assessment framework and portfolio 
template are depicted at Figure 1 . 
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3. ASSESSING PRCX3HESS — SPECIFYING REFORM GOALS AND OBJECTIVES 



Progress assessment should begin with a mapping of the primary and 
secondary goals of the program. School-based reformers should specify 
goals in major program areas. The goal listing probably should include 
statements for nine design elements. These program elements describe 
the school as an organization and schooling as a process. They are 
largely evident in NASDC and other design-based reforms. The basis for 
discussion of the nine program elements and their definitions appear in 
Appendix B. The elements are: 

• Standards and Assessment 

• Curriculum and Instruction 

• School Organization 

• Teacher Professional Development 

• Technology Use 

• School Governance 

• Family and Community Services 

• Public Engagement 

• School/System/Designer Partnering 

Reformers also should state their con^rehensive aims for schooling 
and school improvement . These goals cut across progreim areas and speak 
to school effectiveness generally. We will return to these shortly. 

The design elements are illustrated by examples in this and the 
following chapters. Examples come from the NASDC designs and schools; 
the schools that are discussed are fictitious and based on composites of 
NASDC sites. 

SAMPLE RCFOKM OBJECTIVES 

Goal statements should reflect major program efforts. For exaitple. 
Expeditionary Learning/Outward Bound designers describe the aims of 
teacher professional development in this way: 
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In designing a professional development sequence. 
Expeditionary Learning recognizes that educators must be seen 
both and learners and professionals. As learners, they 
develop first-hand understanding of the design by 
participating in experiences which engage them in the kinds of 
hands-on learning they will create for their students. As 
professionals, they are responsible for the design of 
curriculum and assessment, and are supported by guiding 
facilitation, access to resources and information and active, 
collegial exchange of ideas across the Expeditionary Learning 
network . 



To achieve these goals, reformers at the fictional George 
Washington New American School contend that certain program objectives 
are essential; they hold the following objectives for teacher 
professional development at their school: 

• An^le time will be set aside for professional development and 
collaboration during the school year and in the siimmer. 

• Teachers new to Expeditiorary Learning will attend short-term 
orientation experiences (community explorations, service 
retreats, or wilderness leadership expeditions) to immerse them 
in the design, allow them to reflect on its principles, and 
forge a strong sense of community and team. 

• Teachers will attend summer planning institutes to enable 
collaborative planning of learning expeditions. 

• Teachers will participate in professional development "summits" 
to strengthen knowledge of their craft and introduce new 
practices and subject matter. 

• School visits will be supported so that teachers and 
administrators can exchange ideas and strategies with like- 
minded reformers from different parts of the country. 

These statements set the stage for assessing progress in relation 
to the teacher professional development goals at the George Washington 
New American School. 

Analogously, Co-NECT designers describe their vision for technology 
use in this way: 
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The Co-NECT design provides a vision of a technological 
infrastructure featuring unimpeded access to video, con^juter 
and software tools for all members of the learning community, 
and a flexible communication network linking all coitputers in 
the school with each other, and with con^uters around the 
world. 

At the fabled John Adains New American School, reformers set the 
following objectives: 

• Students and teachers will help create a video culture by 
developing and delivering video and broadcast productions of 
their work and school events. 

• Students and teachers will help create a computer culture by 
learning about and making f recjuent use of con^uter technology, 
as well as, word processing, spreadsheet, data base, and 
communication tools, including HyperStudio and Mosaic. 

• Unirr^eded access to con^uter technology will be promoted by the 
establishment and maintenance of low coitputer/student ratios. 

• An Internet connection and local area network will be 
established and their capabilities utilized for communication, 
data access, and collaboration. 

• Technology coordinators will support wide availability and 
widespread use of video equipment, computers and software 
tools. 

These, like the teacher professional development objectives above, 
make concrete the school's vision for reform; they focus the progress 
assessment activities that follow. Reformers at these two schools would 
draft corresponding statements for the remaining program goals. 

COMPREHENSIVE STUDENT PERFORMANCE AND SCHOOL IMPROVEMENT GOALS 

School reformers typically assess progress against a number of 
coxEprehenslve student perfonnance and achool Isprovexaent objectives. 
Again, these cut across program areas (standards and assessment, 
curriculum and instruction, school organization, etc.) and speak to 
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school effectiveness generally. These are broad objectives for 
in^^roving student performance and strengthening school programs. For 
example, most reformers strive to iiqprove student attendance levels; 
reduce dropout rates; effect successful transitions to work, the 
military, and post-secondary education; and increase teacher attendance. 
Conprehensive objectives for students and the school should be specified 
in the same way that statements are laid out for individual program 
areas. Relevant data should be tracked at the outset and as the progrzuti 
matures. Lists of con^^rehensive student and program indicators appear 
in the next chapter. 

Specification of goals and objectives is step one in the important 
process of establishing shared expectations for the program. This 
process should draw on the talents and views of school staff, parents, 
and other program stakeholders. Appendix C includes a worksheet that 
might be useful in specifying objectives. The objectives given above for 
the George Washington and John Adams New American Schools are exaiqples 
of the types of statements that direct progress assessment. Steps for 
identifying relevant progress indicators, benchmarks, and data 
collection/analysis methods are described in Chapters 4 and 5. Figure 2 
shows the three steps for assessing progress. 
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4. ASSESSING PROGRESS— SPECirSTING PROGRESS IKDICATORS AND BENCHMARKS 



SPECIFYING PROGRESS INDICATORS 

Before considering progress indicators, it might be helpful to 
revisit the overarching cjuestions posed by progress assessment. Again, 
these are: 

• Are the design elements being iit^lemented and are they 
observable in the school? 

• Are participants (students, teachers, parents, administrators) 
making progress in relation to the program's goals? 

• Which activities and strategies are aiding participants' 
progress toward reform goals? 

• which activities and strategies are impeding progress toward 
program goals? 

• Are students and adult participants benefiting from program 
activities and strategies? 

• What do progress levels (and aids and impediments) suggest 
about upcoming work and continuing program improvement? 

In specifying indicators, school-based reformers should think about 
the kinds of data that signify progress for students and the school . 
Both indicators of iit^lementation as well as distant, harder-won 
measures of progress and program outcomes should be specified. 

As earlier ptated, our ideas about progress assessment are inspired 
by the NASDC experience. If you have read about or worked on program 
evaluations, you will notice that the following discussion omits some 
analytic distinctions that typically are made. Traditional distinctions 
between formative and summative evaluation, indicators of program 
inplementation and program intact, and direct and indirect indicators of 
school success are de-en^hasized. The rigid demands of exp>erimental 
design and c[uantif ication are relaxed and the range of telling 
information sources is expanded. We posit that the progress assessment 
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framework does not suffer from these slights and it will portray more 
faithfully the work of school-wide reform. 

We will talk about three categories of indicators that seem to us 
well-suited to assessing the initiation, in?>lementation and effects of 
whole-school designs. We call them iiqplementation obaarvables, 
participants' judgiaants, and outcoma indicators. We believe they have 
utility for assessing progress and fostering program iirprovement for 
design-based reforms. 

Zcplementation Observables 

The first category of indicators includes data about things we call 
implementation observables. These literally are the observable 
manifestations of design coiq^onents; they are things obseirvers can see 
in the school building (mostly) that suggest the program is initiated 
and on its way. For example, for many NASDC designs, first-level 
evidence of implementation would be offered for differing design 
elements by the existence of: 



• Site-based inanagement committees 

• Curriculum quality review teams 

• Standards workshops 

• Assessment inservices 

• Technology planning teams 

• Family services committees 

• Community meetings 



The existence of these groups and activities, in some cases, shows 
that participants are engaged in the hard work of reform. In others 
they are necessary, but not sufficient, precursors to the availability 
of pivotal program resources — like curriculum units, standards 
statements, or technology programs. Their "observability" does not 
support statements about the value of design efforts. As progress 
assessment proceeds, data should be gathered to support judgments of 
quality and effectiveness. Nonetheless, it is important to determine 
early on whether design con^onents are, in fact, being implemented. 
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Implementation evidence is needed to gauge progress, frame program 
adjustments, and understand outcomes — or their absence. 

To continue with this point, reform implementation likewise would 
be suggested by indications the school has in place iiiportant relevant 
conponents of the design, such as: 

• Teacher team planning periods 

• Revised student schedules 

• Multi-age classrooms 

• Classroom learning centers or project areas 

• Student coit¥>act (individual education planning) systems 

• Student portfolio programs 

• Student exhibition centers 

• Conputer and technology centers 

• Parent and community volunteer programs 

Similarly, for designs relying on co-development of resources by 
school reformers and designers, evidence of implementation would be 
afforded by the availability of pertinent local products, such as: 

• Standards statements 

• Curriculum units and lesson plans 

• Interdisciplinary or project-based instructional materials 

• Design-related technology and supports 

In many cases, statements about implementation observables can and 
should go beyond assertions of presence or absence; the data can show 
the levels at which indicators are present. For exair^^le, helpful 
infonnation about the depth of implementation would be obtained by 
counting reformers' accomplishments: the numbers of completed curriculum 
units, or faculty completing professional development, or numbers of 
parents accessing family services, or community members volunteering, or 
businesses and nonprofits participating in the school program. 
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Returning to the Expeditionary Learning teacher professional 
development exair^ile for a moment, the following data about 
inplementation observables would be informative: 

• Amount of time devoted to professional development during the 
year (with indicators of spacing over the year) 

• Amount of time set aside for teacher collaboration during the 
year (with indicators of spacing over the year) 

• Number of days devoted to professional development during the 
summer 

Number of teachers participating (and electing not to) in 
community explorations, service retreats, and wilderness 
expeditions, summer institutes, "summits", and school visits 
Number of learning expeditions developed at the institutes 



As reform proceeds at the George Washington New American School, it 
would be iir^jortant to learn whether these are associated with positive 
change for teachers and ultimately for the program. Questions about the 
program' s results are questions about program outcomes — which are 
discussed later in this chapter. Because it mirrors the reform's 
necessary beginnings, the value of first-level information on 
implementation observables should not be underestimated. 

Lists of iit^lementation observables for the nine design elements 
are given in the Table 1. These may help stimulate users' thinking 
about meaningful indicators of program initiation and iir^lementation. 
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Zable 1 
Iinpleinentation Observables 



Standards and Assessmant 

• Standards statements 

• Schedule of training and materials given to teachers to 
help them understand new standards 

• List of names of members of local standards committees and 
exan^le minutes of meetings 

• Copies of materials given to students, parents, and/or 
community members explaining new standards 

• Available documentation on the links between standards and 
curriculum, and standards and assessments 

• Schedule of training and materials given to teachers to do 
portfolio assessments and other new assessments 

• Sait5>les of portfolios assessments 

• Saitples of alternative assessment tasks not part of 
portfolios 

• Statements of examples of scoring criteria for portfolios 
and non-portfolio assessments 

• Documentation of changes in student achievement 

• Documentation on the links between curriculum and 
assessments 

Currlculxim and Instruction 

• Examples of lesson plans, units of study, etc. 

• Nuinber of lesson plans or units of study developed versus 
number remaining to be completed to cover full curriculum- 
by grade level 

• Sequence across grades of new curriculum (schedule for a 
student) 

• Other changes to courses, course content, and course 
sequencing 

• Documentation of connections to community in curriculum 
areas 

• Description of quality control mechanisms in place for 
newly developed curriculum. For example, teacher peer 
review, review by design team, etc. And, evidence of 
subsequent changes or dropped units (for example, five 
units dropped after peer review) 

• Schedule of training and materials for teachers for new 
curriculum 

• Schedule for completion of all recjuired curriculum units 

• Schedule for adoption of instructional strategies 

• Schedule and materials provided teachers for new 
instructional strategies 

• List of places teachers use for community as classroom 

• List of when the community has come into the classroom - 
speakers, performers 
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• Example of schedule that allows for students' individual 
choices 



School Organization 

• Teachers' school day schedule demonstrating time for 
teaming, curriculum writing, paperwork, etc. 

• Documentation of new/changed staffing patterns including 
master teachers, apprentices, aides, volunteers, 
facilitators 

• List of new grade combinations, teacher team combinations, 
etc., and when they went into effect 

• Relative number of classes covered by these new 
combinations versus classes that have not converted 

• Description of student placement procedures 

Teacher Professional Development 

• Schedule of teacher professional development meetings 

• Workshop materials 

• Workshop attendees roster 

• School visit agendas 

• Documentation of ongoing teacher collaboration 
Technology Use 

• List and location of newly purchased, design related 
equipment (classroom, labs, principal's office) 

• Schedule for purchasing more design related equipment 

• Schedule and materials for training 

• List of software programs /packages used 

• Exait¥>les of curriculum units incorporating technology 

School Governance 

• List of names of members of various committees required by 
design 

• Schedule and materials for training in new governance roles 

• Schedule of committee meetings and exaitples of minutes from 
meetings 

• Significant products of the committees, such as new 
schedules for courses, standards for exemplary student 
products, new standards, plans for technology, school 
iiqprovement plans 

• Newly developed rules, regulations, master contracts, site- 
based management plans, waivers, and district-school 
agreements about school level control over budget, hiring, 
firing, evaluation, or mission 

• List of incentives to encourage new behaviors 

• Master contract changes to accommodate these roles 

• Grievances filed concerning new roles 

• Hiring/layoffs due to design implementation 

• Description of new roles for administrators 

raadly and Conmunity S rvices 

• Name of social services coordinator for school 
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• Schedule for different activities 

• Indicators of utilization of or participation in these 
services 

Public Bngmgeaent 

• Schedule of public meetings 

• Materials explaining reform program for parent and 
community audiences 

• Materials explaining reform for education stakeholder 
audiences 

• Saii5)le3 of newspaper articles and newsletters for lay 
consultation 

• Community volunteer roster 

• Business/nonprofit participation agreements 

School/System/Design Partnering 

• Statements of partnership objectives 

• Schedules for and minutes from partner meetings 

• Products jointly developed by partners 



ierIc 



Participants' Judgioents 

Participants can provide invaluable information about 
iirplementation progress and perceived program benefits. Students', 
teachers', administrators', parents' and designers' judgments are 
important inputs for progress monitoring. While traditional program 
evaluation paradigms rate the information value of perception data lower 
than more direct data on implementation and outcomes, in school-based 
reform we posit their utility is high. The buy-in and sustained support 
of participants in school-based reform are likely (at least minimally) 
related to the quality of participants' efforts. In light of the 
sometimes struggling efforts of whole-school reformers, we believe that 
it is important to solicit and collect good data on participants' 
perceptions. Minimally, they suggest needed program refinements; they 
additionally provide second-level estimates of program effects . 

Student and adult participants can offer useful perspectives on: 

• Design clarity 

• In^lementation feasibility 

• Resource availability (to support and sustain implementation) 
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• Levels of irt^Jlementation and observability 

• Quality of program guidance, resources and activities 

• Satisfaction with student progress 

• Presence of early (then ongoing) program benefits to students 
and other participants 

For various of the design elements, for example, participants might 
be asked to speak to: 



The quality, coir^srehensiveness, and appeal of the curriculum 
Their satisfaction with associated instructional strategies 
Perceived levels of student engagement in the program 
The degree to which students seem to be learning better in 
response to program 

The degree to which teachers seem to be teaching better in 
response to program 

The value of information offered by performance assessments 
Their satisfaction with the changed roles of teachers 
The quality of products issued by management or topical 
committees (e.g. on standards, curriculum, technology, etc.) 
The perceived usefulness of technology to students, teachers, 
and program managers 

Their satisfaction with design-specified student groupings 
(multi-age, multi-year, reduced pull-out, individualized 
instruction, etc.) 



These data would provide important direction for program efforts. 
For several of these areas (e.g. student engagement and achievement 
levels), more direct assessment also is possible and should be pursued. 

Again, using the George Washington New American School teacher 
professional development exait^ile to illustrate, teachers might be asked 
for their perspectives on: 

• The quality of professional development materials and 
experiences 

n 




DRAFT 



I 
I 
I 
I 
I 
I 
I 
I 
I 
I 
I 
fl 
I 
I 
I 
I 
I 
I 



- 25 - 

Their level of understanding of the design and its principals 
Their facility with strategies presented by the workshops 
The usefulness of new practices and subject matter presented at 
workshops 

The benefits of teamwork and ongoing teacher collaboration 

• Suggestions for neglected professional development topics and 
areas for future improvement 

Administrators' judgments on these matters also would be 
informative. Data on participants' perceptions could be collected in 
numerous ways (surveys, progress rubrics, interviews, focus groups, 
logs) ; data collection and analysis methods are discussed in the next 
chapter. 

Outcome Indicators 

Like economic indicators, reform indicators speak to the health or 
quality or effectiveness of the system. They have meaning when they are 
compared to something; reform outcomes can be compared to themselves 
over time and/or to agreed-upon standards for success. They correspond 
more closely to conventional notions of accountability than the types of 
evidence described to this point. Reformers might look for the impact 
of their work, for example, in increased student engagement, parental 
involvement, and teacher retention (in the program) . They might realize 
growing community support or business participation. They might look 
for increased nxombers of ■ students meeting high standards on state 
performance assessments and for fewer students in the lowest score 
categories. Reformers might look for declines in disciplinary referrals 
and special education placements. 

Exan^des of outcome indicators for different program elements, 
include those addressing the: 

• Levels of student engagement in the program 

• Degree to which students are learning better in the program (as 
measured by performance assessments, portfolios, projects or 
demonstrations ) 
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Degree to which teachers are teaching better in response to 
program (as measured by ^good practices' indicators like the 
use of cooperative learning or writing-across-the-curriculum 
strategies) 

Durability of changed rules, regulations, and contracts 
Effectiveness of instructional, social, and health seirvices for 
families 

Involvement of program constituents in public engagement 
efforts 

Results of ongoing attempts to keep and build support 



Unquestionably, some program outcomes are more easily and directly 
measured than others. As an exeunple, direct measures of student 
engagement can be made by trained obseirvers recording student time on- 
task and off -task over a number of occasions. This type of data 
collection is time- and labor-intensive. Alternatively, an indirect 
measure of engagement might be afforded by student attendance levels, 
homework coitpletion rates, or rates of participation in school clubs. 
These indicators would seirve as proxies for more direct indicators of 
student engagement. Though they are not ideal indicators of engagement, 
they provide reasonable information given the time, cost and expertise 
needed to index them. 

Turning for a moment to student performance measures, it is 
iitportant to recognize that they must be aligned with design goals if 
they are to speak clearly to reform progress. Student achievement data 
should come from assessments that focus on the student conpetencies 
addressed by the reform. In the context of today's reforms, students' 
accoitplishments likely are best described by performance assessments 
(also called authentic assessments and constructed response tests) , 
portfolios, learning records, and exhibitions. 

Several states have developmental or operational performance 
assessment programs in place. Many of the NASDC designs also have 
student performance assessment systems associated with them. These are 
designed to represent the complex, important skills the designs seek to 
promote. A good deal of research on performance-based assessment lies 
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ahead for the measurement community, but educators and reformers are 
enthusiastic about the prospects presented by these assessments. The 
display and interpretation of performance assessment data are discussed 
in the next chapter. 

It is iitqportant to say that — as part of the progress assessment — 
data also should be compiled on norm- or criterion-referenced teats. 
Standardized test data offer helpful contextual (supporting) information 
about student populations. It is not expected that these data will 
provide information about intended student or program outcomes. Many 
argue that standardized tests examine only a narrow slice of the 
curriculum, emphasize basic skills at the expense of higher-order 
reasoning, and ignore other inqsortant aspects of academic performance. 
Traditional assessments, indeed, may provide a discouraging view of 
reform progress; standardized test data may not iitqprove as reform 
proceeds. They may even decline. 

On this point, the introduction to this manual asserts that 
reformers should try to check stakeholders' attempts to hold up 
standardized test data as hallmarks of program success or failure. 
Administration of assessment instruments better aligned with program 
efforts should help in this regard, as should the reporting of multiple 
and varied progress indicators. That said, however, standardized test 
summaries are apt to be requested by certain stakeholder audiences 
because they are both familiar and easily understood. Ignoring them as 
contextual infonnation in progress assessment probably would be more 
troublesome than helpful. 

Conprehenslve Student and Program Outcomes 

As earlier suggested, some inportant and telling indicators of 
reform success will be reflected in broad school outcomes — like 
promotion and graduation rates; successful transitions to work, the 
military or post-secondary education; and teacher retention levels — for 
students and others. A number of commonly cited comprehensive outcome 
indicators are listed in Table 2. 

As earlier noted, reformers should catalogue conprehensive measures 
of student and program performance right from the outset. Early and 
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ongoing data collections will allow participants and observers to track 
change over time. In fact, where feasible, the status of key indicators 
prior to design implementation should be recorded; pre-inplementation 
data will serve as an invaluable baseline for assessing progress. Data 
such as the following are likely to be of interest: 

Table 2 

Cooprehensive Student and Program Outcomes 



Student Performance Indicators 

• Attendance rates 

• Homework completion rates 

• Special education referrals and placements 

• Promotion rates 

• Graduation rates 

• Rates of disciplinary referral, suspension and expulsion 

• Drop-out rates 

• Tardiness levels 

• Numbers of students with one or more failing grades 

• Numbers of students performing at or above grade level in 
language arts and/or math 

• High school course loads 

• Numbers of students taking the SAT or ACT Assessment 

• Numbers of scholarships/honors awarded to seniors and other 
students 

• Rates of participation in school activities/organizations 

• Technical school enrollment or entry into military service 

• College placement rates, major selection and non-remedial 
college course enrollment 

• Technical school and college advanced course con^letion 
rates 

• Technical school and college program con^letion rates 

• Entry-level job placement and job performance levels 

Program Outcome Indicators 

• Instructional staff absence rates 

• Retention of teachers in the school/program 

• Numbers of applicants for op>en teaching positions 

• Average teaching experience and degree status of newly- 
hired teachers 

• Parent /teacher conference participation rates 

• PTA and other parent meeting participation rates 
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• Parent volunteer rates 

• Caucus substance abuse, violence, and criminal activity 
rates 

• Numbers and outcomes of fundraising efforts by parents and 
community members 

A worksheet for recording coit^srehensive program data app>ears at Appendix 

PROGRESS BENCHMARKS 

For each indicator of interest, benchmarks (hoped-for 
accomplishments or milestones) should be specified for key points in the 
program's life; that is, reformers should record what they will strive 
for and reasonably can expect by way of implementation progress. For 
example, benchmarks for the numbers of expected curriculum units 
developed, teachers asserting they fully understand the design, and 
students scoring at proficient levels on performance assessments should 
be laid out. 

Program stakeholders with different interests and prior beliefs 
should be called upon to help map benchmarks; alternately, they can be 
asked to review benchmarks before final adoption. The conversations 
that are key to forecasting accomplishments help promote shared 
expectations for progress. Making aims concrete for different program 
areas and time-frames gives stakeholders a chance to weigh in on the 
workplan for school transformation. It provides participants with an 
opportunity to share their views and hear the perspectives of others. 
Specification of benchmarks over time provides foreknowledge of the pace 
at which reform is exp>ected to progress. 

The benchmarks would serve as progress standards for the school. 
Participants might indicate what they hope to see at the end of each of 
the first and second years; they also might note sought-after progress 
and outcomes by the end of year four. Having just discussed 
comprehensive student outcomes, an example appears at Table 3 for a 
school seeking to increase students' academic motivation levels. 
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Table 3 

Progress Indicators/Benchmarks 



Coit^jrehensive 
Student Performance 
and School 
Improvement Goals 


Indicators 


Spring 
1996 
Benchmarks 


Spring 
1997 
Benchmarks 


Spring 
1999 
Benchmarks 


Objective 25: 
Increase students' 
academic motivation 


Attendance 
rates 


85% 


87% 


90% 




Disciplinary 
referral rates 


10% 


8% 


5% 




% of students 
with 

failina arade 


iP% 


17% 


14% 




Drop-out rates 


8% 


7% 


5% 



An indicator worksheet appears in Appendix F. For each program 
objective, it asks reformers to specify progress indictors and progress 
benchmarks. Exanples of indicators were given in this chapter for the 
George Washington New American School; implementation observables, 
participants' judgments, and outcome indicators (including coit^jrehensive 
student and program outcome indicators) should be specified. As 
illustrated by Table 3, indicators and benchmarks should be recorded for 
important time intervals. 
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5. ASSESSING PROGRESS — DATA COLLECTION AND ANALYSIS 



DEVELOPING DATA COLLECTION PLANS 

The last step in initiating a progress assessment is deciding upon 
data collection methods, data sources, timelines and data analysis 
approaches. The assessment probably will rely on a mix of information- 
gathering methods, including both qualitative and cpaantitative 
approaches. 

Data Collection Methods 

The following data collection approaches may yield meaningful and 
useful data: 

• Observables inventories 

• Classroom observation checklists 

• Surveys 

• Interviews 

• Focus groups 

• Document reviews 

• Audio or video record reviews 

• Student assessments (authentic and/or traditional) 

• Student portfolios or learning records 

• Student projects or demonstrations 
Teacher logs or portfolios 

• Progress rubrics 

These should be devised to gather information on the progress 
indicators you have specified. A data collection planning worksheet 
appears at Appendix F. Though description of the strengths and 
limitations of these data collection approaches is beyond the scope of 
this workbook, the methods are described briefly to help readers locate 
additional relevant information. Good discussions appear elsewhere; 
several are referenced at the end of this document. 
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Observables inventories and classroom observation checklists can be 
used to guide and record observations of classrooms and schools. The 
former are helpful in inventorying documentation, products, and other 
resources that are concrete manifestations of program elements. The 
latter are constructed to yield data about what is happening in the 
school and program (rather than what people believe and say is 
occurring) . Tj^ically conducted by trained observers, observations can 
provide information about the types of actions or behaviors the reform 
promotes. Observational data can be invaluable in making sense of other 
program data and in devising recommendations for program iitprovement . 
These methods are labor- and resource-intensive because they require 
substantial aimounts of training and observation time; an additional 
disadvantage is that participants' behaviors may change when and because 
they are observed. 

Surveys, interviews and focus groups are useful for obtaining 
information about the attitudes and opinions of participants and program 
stakeholders; they also can be developed to collect descriptive 
information about the respondents' characteristics. Surveys can cover a 
broad range of topics, be administered to a substantial number of 
individuals, and are relatively inexpensive. Interviews are better 
suited to more coir^jlex questions and open-ended responses; they can 
provide richer, more interesting data. Their disadvantage is that they 
take longer and are more difficult to analyze. As an inf orxaation- 
gathering technique, focus groups bring together individuals to discuss 
topics salient to the progress assessment. The moderator must be 
skilled at leading discussion groups; this is an inexpensive and quick 
information gathering tool . All three methods may yield data colored by 
participants' need to provide socially desirable responses. 

Reviews of existing documents, audio, and video records sometimes 
can provide good information about the comprehensiveness, depth, and 
quality of program resources and activities. Existing records may 
provide good illustrations of data gathered using other means. They 
also can point up underdeveloped areas. 

Progress rubrics can be designed for use in summarizing reform 
accomplishments in given program areas. Rating forma can speak to 

42 
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progress seen by way of observation, survey data collection, docximent 
review and other methods The scales can include categories anchored by 
descriptions of plausible progress levels. For reformers developing 
curricula, for example, a rubric might be devised to index progress in 
curriculiim development and dociimentation. The strong rating category 
might say the curriculiim is largely developed and documented. The good 
case might say that development is well on its way and much is 
documented, and the limited case might say that curriculum is evolving 
and much remains to be dociimented. 

Student performance indicators — including traditional student 
assessments, performance assessments, student portfolios, learning 
records, projects and demonstrations — are key data collection 
instruments in progress assessment. These were briefly discussed in 
Chapter 4. Suggestions for analyzing performance assessment data are 
given below. Teacher portfolios and logs are analogs to student work 
collections and journals (or logs) . They provide a means of examining 
teacher products over time, including instructional units, student 
assessments, committee documents, and other prograun contributions. 

Exan^le instruments from various NASDC designs are included in the 
appendix to this workbook. Future printings of this manual will include 
additional and updated data collection forms from NASDC teams and 
schools. An example observables checklist, classroom observation guide, 
interview schedule, and progress rubric appear in Appendices G through 
K. Sample teacher, administrator, and student surveys also are 
included. NASDC hopes to soon develop reform progress surveys for 
teachers, adiiiinistrators and parents; these will speak generally to the 
goals and activities of school reform. Student assessments of different 
types already may be in use in your buiJ.ding, district or state. Many 
NASDC designs have performance assessments associated with them. Some 
additionally offer frameworks for teacher logs or portfolios. 

Data Sources and Timelines 

Sources of data about implementation levels and outcomes include 
students, teachers, administrators, parents, community members, and 
designers. Program records — including committee minutes, program logs 
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or products, workshop materials, and student and personnel files — are 
in^jortant information resources, as are existing external information 
sources, such as school and system-level records and databases. In 
addition to data collection methods and sources, the planning worksheet 
at Appendix F asks for the time-frames within which data will be 
obtained. 

Data Analysis Methods 

As was the case for data collection approaches, careful 
descriptions of analytic techniques are beyond the scope of this guide. 
Good treatments of methods likely to be useful in progress assessment 
are listed in the bibliography. Only a cursory discussion appears here; 
its intent is to give the reader enough information to find appropriate 
references . 

Very many of the data generated by progress assessment can be 
presented meaningfully as counts or percenta . Data for in?)lementation 
observables, for exan^le, often are usefully provided as counts. Multi- 
categorical data can be summarized using frequency distributions and 
measures of central tendency. Score data from student performance 
assessments generally are multi-categorical . Performance assessment 
scores tj'pically correspond to four or five proficiency levels. Score 
distributions showing the number and percent of students at each level 
gives readers information about typical student performance and the 
proportions scoring in the highest and lowest categories. Provision of 
a median (the point dividing the distribution in half) and mode (the 
most frequently occurring data category) additionally summarizes 
frequency data. Shifts in score distributions over time — showing fewer 
students at the lowest score categories and increases in average 
performance — are telling indicators of student progress . 

In producing frequency displays for data with many categories, the 
analyst generally examines detailed distributions and summarizes it 
using tables or graphs. If the analyst wants to describe the data using 
a single figure, an arithmetic mean (average) , median or mode can be 
used; the range (lowest and Highest points) and an indication of 
variability also is helpful. 
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In some cases, researchers would want to subset the data and 
describe them separately for varied types of respondents (e.g. teachers, 
parents, and administrators; or new teachers and veteran teachers) . 
Cross tabulations of the data provide the needed information. 
Approaches to testing the statistical significance of group differences 
rely on t-tests, chi-square and variance analyses. The strength of the 
relationship between two variables can be described using correlation 
coefficients . 

No matter which analytic tools are en^loyed, the final step is to 
author texts and develop tables and graphs to describe salient findings 
in terms that will resonate with stakeholders. The reform portfolio — 
next described — is intended to summarize the data gathered by progress 
assessment. By way of the portfolio, reformers will describe progress 
and challenges and make recommendations for upcoming work. 
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6. PORTRAYING PROGRESS— CREATING A SCHOOL REFORM PORTFOLIO 



This workbook provides a template for developing a New American 
Schools Reform Portfolio. The reform portfolio is meant to provide a 
longitudinal record of school progress in relation to reform intents and 
design features. As described in earlier chapters, the assessment 
framework is designed to elicit varied and rich data about initial 
irtplementation levels, early outcomes, and — over time — later indicators 
of progress and program effects. The reform portfolio records things 
assessed, refined and learned. It highlights successful program 
elements and point out remaining challenges. The portfolio offers 
suggestions for upcoming work and fosters program inprovement . 

The reform portfolio additionally provides important and necessary 
accountability information for numerous stakeholder audiences, including 
state and local officials, parents, community members, funders, and 
fellow reformers. The reform portfolio helps establish the agenda for 
ongoing school irqjrovement and promotes fuller and continuing 
understanding of reform progress for present and future transforming 
schools . 

NEW AMERICAN SCHOOL REFORM PORTFOLIO TEMPLATE 

The reform portfolio template has five sections; it includes: 

• A statement of the school's vision and objectives for reform, 

• A description of the student population, school and community, 

• Descriptions of initial irtplementation levels, early outcomes, 
and — over time — later indicators of progress and program 
effects, 

• A summary of reform progress and challenges, with 
recommendations for future reform work, and 

• Appendices, providing data displays to support the body of the 
portfolio. 
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The parts are depicted in Figure 3 and described below. A sanple 
portfolio appears at Appendix A. 

Tha Dttsign axxd Program Vision 

The portfolio begins with a short portrayal of the design and the 
school's vision for reform. The direction of major program efforts is 
described, as are the student and program outcomes sought. This 
introductory section sets the stage for the data summaries to follow. 
An example summary for George Washington New American School 
{Expeditionary Learning/Outward Bound) appears in the appendix. 

Most authors will elect to precede this introductory section with 
an Executive Summary, providing an encapsulated version of the prograun 
description, discussion of progress and challenges, and recommendations 
for future work. 

Description of the School and Community 

Section two provides a description of the school and its community. 
Discussion of district and school characteristics, family and student 
characteristics, school staffing and budget levels provides useful 
contextual information. Supporting data might appear in the appendix to 
the portfolio. A sarrple description for Thomas Jefferson New American 
School (a fictitious Audrey Cohen school), as well as, a summary of 
context data for the James Madison New American School — a Community 
Learning Centers school — given in the appendix. A worksheet for 
recc_-ding context information about students and the school appears at 
Appendix L. 

Description of laplementation Levels and Outcomes 

This section of the portfolio reports the most telling and 
important infomiation about irrplementation levels and outcomes. 
Narrative and graphic progress summaries would appear for each major 
program area (curriculum and instruction, standards and assessment, 
school organization, teacher professional development, etc.). 
Additionally, available conprehensive student and program data are 
reported, including attendance, promotion, graduation, drop-out, college 
placement, parent and community involvement rates, and so on. 
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For each major program area (and for the coir^jrehensive program 
data) , the information is organized as an information pyramid. Exanples 
of information pyramids with three levels are provided in Appendix A for 
several of the design elements; they begin on page A. 13. The top level 
of the information pyramid is meant to give a short, directed portrayal 
of the most interesting information about in^lementation and outcomes. 
Results might be presented in bulleted format to make easier the 
reader's review of findings and progress. Note for the appendix exanqples 
that program goals are recounted in side-boxes to highlight the 
relevance of reported data. 

The second level gives a more extended, descriptive and qualified 
discussion of the data and their context. Easy-to-read tables and 
graphs might appear in the second level. The third level includes case 
study reports, narrative data, or san^le materials to illustrate and 
maker richer the information provided in the top level. 

The materials in the appendix draw on qualitative and quantitative 
data collected by Expeditionary Learning/Outward Bound, Roots and Wings, 
Co-NECT, and Audrey Cohen school reformers during the 1993/94 school 
year. Most are based on information coirf)osites from a nximber of schools; 
they serve only to illustrate the information pyramid format. 

Summary of Progress, Challenges and HecosBsendatlons 

The fourth part of the reform portfolio provides a summary of key 
program acconplishments and a discussion of remaining challenges. Where 
needed and in light of reformers' observations, suggestions are made for 
realignment of plans and program goals. An example progress summary for 
George Washington New American School appears in the appendix. Again, 
the final section of the portfolio is its appendix section which would 
include data summaries supporting information provided in the body of 
the portfolio. 

At each installment of the portfolio and as reform is informed by 
experience, more niunerous and telling information about progress and 
program outcomes will be offered. The school reform portfolio is likely 
to promote fuller and continuing understanding of reform progress for 
present and future New American Schools. 



9^. DRAFT q 



I 
I 
I 
I 
I 
I 
I 
I 
I 
I 



I 



- 41 - 



ASSESSING AMD PORTRAYIHG RSTOBM 

This workbook was designed to help school -based reformers marry the 
work of reform with the analysis of change. It provides tools that 
NASDC and other design-based reformers can use in assessing and 
portraying school transformation. This manual lays but and describes an 
assessment framework called progress assessment. The framework directs 
reformers to involve participants and stakeholders in specifying progrcua 
goals, change indicators, and data collection/summary plans. It calls 
for establishment of early and ongoing systems for progress monitoring. 
The workbook provides a teitplate, described in this last chapter, for a 
New American Schools Reform Portfolio. As earlier suggested, the New 
American Schools Reform Portfolio likely will serve numerous audiences 
and address varied objectives. The portfolio provides a vehicle for 
deliberation about school reform; it provides an ongoing record of 
reform activity, recommendations for program in^srovement , and an agenda 
for future work. The portfolio also will provide iitqportant 
accountability information to program stakeholders . Fellow reformers 
and the education community will look to the portfolio for contributions 
to the evolving knowledge base about school-wide reform. We assert that 
progress assessment and the resulting portfolio will further the success 
of reforming schools. 
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AND OUTCOMES A. 13 
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Family and Community Services 
Pvtblic Engagement 
School/System/Designer Partnering 
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School Governance 
Family and Community Services 
Pvtblic Engagement 
School /System/Designer Partnering 
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School Inqprovement Goals 



*Shls reform portfolio reflects the observations of George Washington 
New American School reformers; it describes program ixoplementation 
levels and outcomes daring the period from fall 1993 through spring 
1994. This reform portfolio periodically will be updated to provide a 
longitudinal account of school progress in relation to design goals and 
features. Please call or write XXX to inquire about futxire reports. 
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IKTBODDCTIOK TO SHE DBSIGH AMD MAJOR KETOBM GOALS 
Gttorga Washington Hew American School 

George Washington New American School chose to become a center of 
Expeditionary Learning in 1993. Expeditionary Learning is a 
comprehensive school design based upon ten design principles which grow 
in large part out of the experience and philosophy of Outward Bound. 
Outward Bound, founded by Kurt Hahn in 1941 and brought to this country 
by Joshua Miner and Charles Froelicher in 1962, has at its core the 
belief in the value of transformative experiences of physical challenge 
and service, especially when supported by the creativity and teamwork of 
small working groups. Such experiences offer a powerful antidote to the 
apathy and alienation which plagues many schools, particularly when they 
are designed to help students meet high standards for academic 
performance . 

Using Expeditionary Learning design principles we hope to transform 
every aspect of our school. The design calls for the con?>lete 
reorganization of time, space, and relationships in order to allow 
teaching and learning to take the form of intellectual and physical 
expeditions. The change required is con?>lex, involving profound changes 
in school culture, and the ten design principles provide vision and 
direction. They require building greater continuity of relationships 
between students and teachers, drawing on the power of small groups, 
creating curriculum that is more focused and in-depth, and building 
stronger links between our school and community. A description of the 
Expeditionary Learning design principles and program coit¥>onents follows. 

Expeditionary Learning Design Principles 

Learning is an expedition into the unknown. Expeditions draw together 
personal experience and intellectual growth to promote self-discovery 
and construct knowledge. We believe that adults should guide students 
along this journey with care, con?>assion, and respect for their diverse 
learning styles, backgrounds, and needs. Addressing individual 
differences profoundly increases the potential for learning and 
creativity of each student. 

Given fundamental levels of health, safety and love, all people can and 
want to learn. We believe Expeditionary Learning harnesses the natural 
passion to learn and is a powerful method for developing the curiosity, 
skills, knowledge and courage needed to imagine a better world and work 
toward realizing it. 

1. The Primacy of Self -Discovery. Learning happens best with emotion, 
challenge and the requisite support. People discover their abilities, 
values, '"grand passions," and responsibilities in situations that offer 
adventure and the unexpected. They must have tasks that require 
perseverance, fitness, craftsmanship, imagination, self-discipline and 
significant achievement. A primary job of the educator is to help 
students overcome their fear and discover they have more in them than 
they think. 
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2. The Having of Wonderful Jdeas. Teach so as to build on children's 
curiosity about the world by creating learning situations that provide 
matter to think about, time to experiment, and time to make sense o£ 
what is observed. Foster a community where students' and adults' ideas 
are respected. 

3. The Responsibility for Learning. Learning is both a personal, 
individually specific process of discovery and a social activity. Each 
of us learns within and for ourselves and as a part of a group. Every 
aspect of a school must encourage children, yoxing people, and adults to 
become increasingly responsible for directing their own personal and 
collective learning. 

4. Intimacy and Caring. Learning is fostered best in small groups 
where there is trust, sustained caring and mutual respect among all 
members of the learning community. Keep schools and learning groups 
small. Be sure there is a caring adult looking after the progress of 
each child. Arrange for the older students to mentor the younger ones. 

5. Success and Failure. All students must be assured a fair measure of 
success in learning in order to nurture the confidence and capacity to 
take risks and rise to increasingly difficult challenges. But it is 
also important to experience failure, to overcome negative inclinations 
to prevail against adversity and to learn to turn disabilities into 
opportunities . 

6. Collaboration and Competition. Teach so as to join individual and 
group development so that the value of friendship, trust, and group 
endeavor is made manifest. Encourage students to con^te, not against 
each other, but with their own personal best and with rigorous standards 
of excellence. 

7. Diversity and Inclusivity. Diversity and inclusivity in all groups 
draxoatically increases richness of ideas, creative power problem-solving 
ability, and acceptance of others. Encourage students to investigate, 
value and draw upon their own different histories, talents and resources 
together with those of other communities and cultures. Keep the schools 
and learning groups heterogeneous. 

8. The Natural World. A direct and respectful relationship with the 
natural world refreshes the human spirit and reveals the important 
lessons of recurring cycles and cause and effect. Students learn to 
become stewards of the earth and of the generations to come. 

9. Solitude and Reflection. Solitude, reflection, and silence 
replenish our energies and open our minds. Be sure students have time 
alone to explore their own thoughts, make their own connections and 
create their own ideas. The give them opportunity to exchange their 
reflections with each other and with adults. 

10. Service and Compassion. We are crew, not passengers, and are 
strengthened by acts of consequential seirvice to others. One of a 
school's primary functions is to prepare its students with the attitudes 
and skills to learn from and be of service to others. 
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Program Compozxttnts 

1. Schedule, Structure, Teacher-Student Rel&tionahipa . Expeditionary 
Learning requires a complete reconsideration of the relationships among 
staff and students, as well as the schools' arrangements of time and 
space. Schools nuist eliminate the fifty minute period and replace it 
with a schedule organized to accommodate learning expeditions that may 
engage students full-time for periods of days, weeks, or months. 
Tracking is eliminated. Teachers teach the same group of students for 
at least two years, and preferably longer. 

2. Curriculum. Expeditionary Learning engages the learner in 
situations that provide not only context but consequence. Learning 
expeditions which often encon^ass several disciplines replace subject- 
separated classes. The curriculum makes intellectual learning and 
character development of equal iirportance and encourages self -discovery . 

3. Standards and Assessment. Expeditionary Learning uses real -world 
performance as the primary way to assess student progress and 
achievement. Assessment reflects world-class student performance 
standards, as well as world-class standards for curriculum, instruction, 
and opportunities to learn. Portfolios are a primary vehicle for this 
assessment. 

4. Staff Development. Expeditionary Learning depends upon and invests 
in the ongoing development and renewal of staff. Flexibility in hiring 
or reassignment, and a substantial investment in year round staff growth 
is required. 

5. Linkages to Community and Health Service Organizations. To provide 
necessary support to students and their families, working relations with 
the appropriate service agencies will be developed. 



Conclusion 

George Washington New American School and Expeditionary Learning place 
the development of intellect and character together at the pinnacle of 
educational goals. Our program eit^hasizes the critical roles that 
teachers play a curriculvun designers, instructional guides, and 
facilitators whose assessment practices enable both students and 
teachers to learn and grow. Teachers and students alike continually 
work on investigating, explaining and questioning; on being respectful 
and responsible; on exercising good judgment; and on making thoughtful 
choices and wise decisions. We hope in the coming three years to 
transform our school into a true center of Expeditionary Learning. 
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DSSORIPTION or •CHOMAS JZSTERSON M£H AMERXCAH SCHOOL 



Thomas Jefferson New Aioerican School serves the public elementary school 
population for the Independence School district in Presidents County, 
Pennsylvania. The school is located in one of the poorest communities 
in the United States and serves approximately 873 students in 
kindergarten through sixth grade. There are between four and five 
teachers per grade. In the 1993-94 school year, the school population 
consisted of 108 to 163 students per grade. Although it is rich in 
cultural and social resources the school is limited in economic 
resources. Led by its dynaitdc superintendent, who has committed most of 
his professional life to helping his community, Thomas Jefferson New 
American School is an integral part of an economic development strategy 
which attenpts to establish many small businesses in Independence, which 
will eitqploy graduates of the elementary and secondary schools, thus 
keeping students in the community and contributing to its growth. 
Although Thomas Jefferson New American School exists virtually 
surrounded by cotton fields and catfish ponds, the school supported by 
the Purpose-Centered System of Education, encourages children to use 
regional resources for the conpletion of their Constructive ActionsO. 
Partnerships with institutions in the region have been estzdalished. 
Traditionally, this has been the area of the state with the lowest 
scores on student achievement outcomes (i.e. Stanford Early School 
Achievement Tests) used by the State Department of Education for the 
assignment of accreditation levels. For the school district, about 98% 
of the 1,417 students are African-American and 98% of the students 
receive free or reduced fee lunches. 

Adapted from Audrey Cohen Year 1 Phase 2 Report, January 1995. 
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SSAKDARDS AND ASSXSSKEMT 



Zxqplamentation LavAls and Outcomes 

* Substantially more James 
Monroe New American School 
third graders scored at or 
2±)Ove satisfactory on the 
1994 MSPAP language, 
mathematics, and science 
sections than did third 
graders in 1993. 

* Significant gains also 
were seen in fifth grade 
reading, language, 
mathematics, science and 
social studies performance. 

* Writing performance for grade three in 1994 did not improve in 
relation to 1993. For fifth graders performance declined. 



SZANDABDS AND ASSESSMENT 



Research and Additional Observatiozxs 

MSPAP provides proficiency scores in subject areas linked to 
descriptions of what students know and can do in relation to the 
Maryland learning outcomes. MSPAP proficiency level cut scores were 
established by content area committees of classroom teachers, 
principals, local school system content specialists, Maryland college 
and university professors, and local school board members. An 
articulation study of the Roots & Wings curriculum and MSPAP objectives 
is now being coiq3leted. 

The gains described above (and shown below) were seen despite only 
partial in^lementation of most program elements at James Monroe New 
American School in 1993/94. We expect much greater gains in 1994/95 as 
we approach full implementation. The 1994 outcomes were not fully 
consistent across measures. Writing scores were disappointing; we have 
had trouble scheduling enough time for instruction in writing, and the 
sobering results on this measure have helped us see the need to redouble 
their efforts in this direction. 

In addition to MSPAP student assessment, teachers collected samples of 
student work from language arts, mathematics, and WorldLab over the 
course of the year. These are used along with curriculum-specific 
assessments to evaluate growth. This first look at our students' 
performance via MSPAP, portfolios and classroom assessments gives us 
confidence; we believe we are on the right track and are making a 
difference with the children in our school. 

Adapted from Roots £ Wings Fifth Quazrterly 
Report, Phase II, January 1995. 
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One of Roots 6 tfings' partners, 
the MD State Departntent of 
Education, is a leader in defining 
student performance standards and 
devising assessments. The MD 
School Performance Assessment 
Program (MSPAP) measures coaplex 
problem solving, critical and 
creative thinking skills using 
rigorous, realistic, often multi- 
disciplinary, tasks. 
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COItRICDX;aM akd xhstrxtcsioii 



Xaplamentatlon Xi«v«l8 aod Out cosies 



* Ethnographers spent 5 weeks at 
George Washington New American 
School and found that expeditions 
were carried out in all classrooms 
and occupied at least 2 hours a day. 

* Expeditions involved teachers 
teaming in their planning and to 
some extent in their inqplementation. 

* They required schedule alteration; in 
most classrooms there were blocks of time 
devoted to expeditions. 

* Expeditions addressed all six domains 
targeted as central to development of 
students' skills and knowledge; 
technology was used extensively and was well integrated. 

* Teachers taught disciplines and skills to address expeditions' 
guiding questions rather than teaching them for their own sake; 
students were provided with multiple avenues to learning- and 
exhibiting what they learned. 



For Expeditionary Learning 
faculty, the expedition is a 
metaphor for learning and an 
approach to pedagogy that informs 
professional development and 
practice. They are conprised of 
projects that end in culminating 
e3^>edltions of learning. Through 
expeditions, teachers become 
curriculum developers, make 
resources available and guide 
their use, help students formulate 
and answer questions, and assure 
students have the skills needed to 
tackle the challenging, multi- 
disciplinary issues they address. 



CDRRICOLtM AND INSSROCSION 



Research and Additional Observations 

During 1993/94 ethnographers spent approximately 5 weeks in George 
Washington New American School. They devoted the first week to becoming 
familiar with the school and remaining weeks obtaining in-depth 
understanding of classrooms and the way in which expeditions were 
iitqplemented. Ethnographers also selected six students for case study and 
shadowed them in classes, informally interviewed them and their 
teachers, and collected materials from their portfolios. Additionally, 
in fall 1993 and spring 1994 site visitors spent 2 days conducting 
formal and informal interviews with teachers, administrators, students 
and parents; observing classes and other activities; and learning from 
participants about iii¥)leroentation progress and discussing challenges. 

In addition to observations described above, ethnographers and site 
visitors observed that there was an en^hasis on group work and an 
atten^t to make classes and groups inclusive. Learning occurred both in 
the classroom and outside it through bringing in experts and field 
trips. The classroom walls were permeable and field trips became an 
occasion for learning and carrying out projects. Character development 
was eirphasized in all expeditions and was cited by many teachers as an 
in¥)ortant outcome of expeditions. 

The expeditions differed greatly in the extent to which student 
interests or questions fueled the expedition. In some cases, a fairly 
tight teacher-directed curriculum was pursued; for other expeditions 
students had opportunities to debate the direction of the expedition 
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itself, the nature of their projects and how their group would carry 
them out. 

Quiet individual reflection was scheduled during the day or week in some 
classrooms. In others, reflection was encouraged through student 
journals and discussions at the beginning and end of the day about the 
expedition or group process. 

Adapted from EL/OB First Year In^lementation Report, September 1994. 



COimiCOLUM AND XHSTBUCSION 



The ZiasscrM o£ Ziaamlng Bxpeditions 

by Leah Rugen and Scott Hartl 

1 felt like a real scientist. When I looked into the 
microscope and found the specimen, it was awesome. When you 
are done with the expedition, you go home and tell your mom 
and dad what you learned, and they practically don't even 
know what you are talking about. Six weeks ago I would never 
have known about pond life. 

-a 5th grader's journal entry 
Dubuc[ue, Iowa 

Students in Expeditionary Learning schools spend most of their time 
engaged in sustained, in-depth studies of a single theme or topic. The 
experiences, which generally last four to nine weeks, include strong 
intellectual service, and physical dimensions. Intellectually rigorous 
projects and purposeful fieldwork- the heart of each expedition- provide 
a vision and a strategy for assessment that are fully integrated with 
curriculum and instruction. 

A Spectrum of Possibilities 

Within a range of elementary, middle, and secondary schools, in both 
urban area and small cities, teachers are testing the boundaries of what 
it means to launch learning expeditions. Some expeditions focus on two 
academic disciplines, while others integrate multiple disciplines such 
as math, science, humanities, and arts. Some are four to six weeks in 
length; others last three months. Expeditionary learning explicitly 
joins intellectual and character development. The organizing center of 
the expedition is an intriguing and open-ended theme or topic, which 
defines the territory but also generates (questions. Themes or topics 
naturally cut across disciplines, though some, such as Pond Life and 
Urban Renewal, lend themselves more to one discipline than another. 
Guiding questions give learning expeditions a structure. For exan^le, 
at the School for the Physical City, the question ""How can we tell when 
a community is thriving?" gave focus to the theiite Our City, Ourselves. 
Across all sites, as the initial learning expeditions unfold, teachers 
weigh which themes and questions work and which seem too broad or 
narrow. They consider the role of the student in developing guiding 
questions and in shaping the expedition plan. At Dubuc[ue's Central 
Alternative High School, for example, teachers offer students academic 
credit for effective participation in planning meetings. 

Sifting through the spectrum of possibilities for learning goals and 
developing a focused set of priorities are the toughest challenges of 
planning a learning expedition. At King Middle School in Portland, 
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Maine, teachers wanted to ensure that they could satisfy their major 
objectives for each discipline. The social studies teacher discovered 
she could address aspects of world culture, but not American history, 
which was the schooled focus of the following year's curriculum. 
Similarly, the science teacher needed to focus on biology, and the 
language arts teacher knew her students should focus on writing a major 
research paper and persuasive essays. 

After a lively discussion of possible themes to address each of these 
needs, the teachers settled on Endangered Species. In their social 
studies work, students use a case study approach to examine the complex 
interactions between hiooans and the environment of endangered species in 
selected non-American cultures. Their science work focuses on 
ecological issues, and math includes the collection and presentation of 
data on endangered species. 

Thtt Journeys Take Shape 

A learning expedition is shapeless until ideas for projects are 
developed. Projects unify and ignite student learning by calling for 
concrete products or actions that address authentic problems and 
situations. After the King Middle School teachers chose their theme, 
they brainstormed ideas for projects that would integrate the social 
studies and science content with writing. The projects they agreed on 
included a debate, a can?>aign to inform the school and community about 
endangered species issues, and an in-depth research paper on an 
endangered species enconpassing several disciplines. 

One of the tensions in developing projects is finding the balance 
between group and individual assignments. Individual work ensures 
student engagement and gives teachers the opportunity to assess the 
strengths and challenges of each student. Portfolios are a primary 
assessment vehicle, within individual projects, however, students have 
opportunities to share skills and resources and critique one another's 
work. 



Teachers also plan group projects with specific cortponents that are 
clearly the responsibility of individual students. For exan?>le, in 
creating a field guide to a local pond, each 5th grader at the Table 
Mound School in Dubuque was responsible for his or her own page in the 
field guide. As students become accustomed to project work and develop 
strong work habits and high standards for their work, group projects 
grow stronger. 

Preparation for the Expeditions 

A driving question in the planning of learning expeditions has been how 
best to prepare students for sophisticated projects. Over time, 
students tackle an array of tasks and experiences that develop and 
stretch their background knowledge and skills. Teachers cultivate 
students' habits of work, thinking and judgment through the daily 
rituals of reading, writing, problem solving, and discussion. Most 
irtportant, preparation for sophisticated work relies on the development 
of a strong school culture with a common vision and experience. 

The use of fieldwork and service is perhaps the most radically different 
dimension of learning expeditions. A new set of school norms soon 
develops, as clipboards for field notes and journal entries join 
chalkboards and three-ring binders as essential school equipment. 
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Teachers discover the multiple purposes of field work- for immersion 
into a topic, deeper investigation and research, team-building, and 
adventure- as they find their way through barriers of tradition, 
planning, logistics and safety, and time. The passive model of field 
trips, in which students followed a guide through a museum or business, 
gives way to a more active approach. Students interview passers-by, 
sketch buildings, measure shadows, and make observations. They venture 
out to answer questions and follow leads that cannot be looked up in 
textbooks . 

When fieldwork is joined with meaningful service, the consequences and 
purpose of learning are made even clearer to students. Middle school 
students at the Hernandez School in Boston, for example, surveyed 
community members to determine the best uses for several vacant lots 
near the school. After students presented their plans and scale models 
to parents and community members, a local environmental organization 
decided to use one of their proposals in developing one of the lots. 
Not only had their ideas been heard and respected, but the students had 
also made a needed contribution. 

Like every other aspect of learning expeditions," however, purposeful 
fieldwork and service present a great challenge. They require flexible 
scheduling and rethinking the grouping of students and the roles of all 
school staff. Field experiences, though, need not be elaborate or long- 
distance endeavors. Students learn much, for exan5>le, by interviewing 
the owner of a local business or developing an ongoing relationship with 
staff or residents of a local nursing home. In addition, visitors from 
the community- experts, parents, and neighbors- bring the outside world 
into the classroom. 

Kurt Hahn, the founder of Outward Bound, captures the spirit of our 
endeavor: 

I regard it as the foremost task of education to ensure the 
survival of these qualities: an enterprising curiosity, an 
indefatigable spirit, tenacity of pursuit, readiness for 
sensible self-denial, and above all, conpassion. 



Copyright 1994 by Leah Rugen and Scott Hartl. 
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TKACBBR PROraSSIOrau:! DEVELOPMENT 



InpleiDentation Levels and Outcomes 

* 78% of George Washington New 
American School teachers 
participated in 1993 summer 
institutes and/or mini- 
sabbaticals. 85% of 
participants said these 
activities better prepared 
them to collaboratively plan 
and write expeditions. 

* Over 50% of teachers 
participated in orientation 
experiences. Participants said 
they now better understand the 
EL community's principles of 
intimacy and caring, responsibility for learning, collaboration 
and coit?>etition, and diversity and inclusivity. 

* 78% of teachers participated in school -based planning meetings. 
Teachers described these as inportant vehicles for making school 
policy and keeping informed about other school teams' activities. 



VEACaZR PROFESSIC»IAL DEVELOPMENT 



Kasearch and Additional Observations 

Data on teachers' judgments of implementation levels and the benefits of 
professional development were gathered via surveys administered in 
spring 1993 and fall 1993. Teachers' views of EL/OB staff development 
activities were overwhelmingly positive. Teachers felt that they 
learned EL/OB principles and components during their staff development 
activities and gained new respect for their colleagues. A few said they 
had made some fairly dramatic shifts in their approach to teaching. 
This was especially evident in teachers' responses to the Outward Bound 
Wilderness Expeditions. A minority of teachers felt that too much time 
was spent on team building activities, that staff development was not 
sufficiently linked to their needs (practical applications, the urban 
classroom, and school planning) . Suggestions for iuqproving staff 
development included scheduling to accommodate teachers' needs; more 
hands-on work with follow-up in the classroom; more attention to 
administrative support for EL/OB teachers; and use of experienced 
teachers to facilitate workshops, including those in the EL/OB project. 

Adapted from EL/OB Interim Report, February 1994. 



TEACHER PROrESSIOKAL DEVELOPMENT 



Siuoaar Sxnnotits and the Expeditionary Learning Process 

In recent years, researchers and administrators have gained a renewed 
appreciation of teachers as active participants who construct and act on 
knowledge about their craft. There has been a corresponding shift in 
research from a focus on teacher effectiveness and behaviors toward the 
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professionals. As learners, they 
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study of how teachers make sense of their craft — their constructs about 
the nature of knowledge, teaching and learning, and how these beliefs 
play themselves out in the classroom. (Clark, 1988; Richardson, 1994) 

Within this evolving context. Expeditionary Learning Outward Bound has 
designed a professional development experience — we called it a summit — 
which aims to draw upon teachers' knowledge about their craft while 
introducing them to new practices and subject matter. Summits 
accoitplish this by immersing teachers in a week-long' leaxming expedition 
focused on a particular subject. Each of this stimmer'a three summits 
had its own focus: architecture (taught by Ron Berger and Russann 
Cook) , geology (taught by Ron Berger and John Reid) and the Cherokee 
Indian Nation (taught by Bill Anderson and Leo Snow) .' Expeditionary 
Learning's Mary Johnston organized and designed the summits in 
partnership with these teachers. 

During the summits teachers gain a chance to participate as learners and 
deepen their inquiry about their practice. In collaboration with 
"master teachers" as well as university professors, they develop their 
own professional expertise in the subject matter that they will teach; 
they get ideas eibout how to integrate the content they learn at the 
summit into their own classrooms; and they have as opportunity to 
observe and work with a master teacher modeling a learning expedition. 

The following are personal inqjressions of the architecture summit, held 
July 11-17 in Portland, Maine. 

Portland, Maine 
July 13, 1994 

I' El sitting in our workroom — a small studio with drafting tables packed 
tightly from end to end. It's hot outside, but an ocean breeze reaches 
us through several windows over-looking the Southern Maine Technical 
College where we'll be based for the next five days. If you look out 
the east facing window you'd see the Casco Bay and the waves crashing on 
the beach below. But no one lifts his or her head to take in the view. 
Our attention is fixed on the floor plans in front of us. If we do look 
up, it's only to get a quick "critique" from a neighbor, search for the 
architect's scale or a teiqjlate. 

The intensity and purposefulness has this room feeling like an 
architect's office racing to meet an iitportant deadline. That's just 
the kind of atmosphere that Ron Berger and Russann Cook want. As 
educators, Ron and Russann believe in immersing their students in a 
discipline as professionals know it. We handle professional quality 
tools and materials. The language of the craft has infiltrated our 
conversations. Terms of art like cornice, lintel, ell and bearing wall 
that would have seemed foreign only a day ago are tossed around with 
ease. To be sure, we're apprentices, not professionals. But there's a 
seriousness about the work, a set of expectations and standards and as 
attention to detail that only comes from immersing yourself in the 
culture of a profession. 

The ebb and flow of erasers, Prismacolor pencils, specifications and 
ideas is something of a mystery to me. I can never seem to follow their 
movements. Someone borrows a staircase from a Frank Lloyd house. He 
spends an hour meticulously rendering it to scale. A little while later 
it appears, slightly altered, in someone else's drawing. At another 
time, someone discovers the proper distance of a sink from other 

o 66 
ERIC 



- A. 23 - 



ERIC 



fixtures In a bathroom. When it comes time for someone else across the 
room to design her own bathroom she appears to have plucked the precise 
measurement out of the air. 

The format of each day is largely the same. After breakfast Russann 
Cook, a teacher, professional architect and Ron Berger's co-leader, 
instructs us in the techniques and skills we will need to become 
proficient draftsmen. The first day we were introduced to the tools of 
our trace. Yesterday we learned to use an architect's scale — a 
triangular ruler-like instrument that enables us to work in scale. 
Today we learned the art of calligraphy. Following the technical 
session we adjourn to another "space" (the word room seems to have 
vanished from our voceibulary) where Ron invites us to try our hand at a 
design — i.e., a police station for a town of fifty thousand people — and 
a "quick challenge" — i.e., constructing a bridge or tower from 
toothpicks, clay and gvun drops. Afterward we wander around the gallery 
of stmictures and designs laid our on the tables or hanging from the 
walla before settling down to critique the work of one of two brave 
individuals who wemt feedback on their work from the entire group. 
After lunch it's back to our primary project of the siunit: designing a 
house. The evenings are taken up with lectures, discussions or field 
trips to study local architectural 
exeiqplars . 

The high level of standards, the late hours, the exacting work have been 
stressful for some, exhilarating for others. But Ron is clear, be wants 
from us what we want from our students: the best quality work we're 
capable of producing. For some this means altering the parameters of 
the project to make it more meaningful. 

One of the themes of the summit has been how to maintain high standards 
while allowing students to make projects their own. Ron calls it 
negotiating. *I like negotiating." He tells us. "I want students to 
bargain with me. When I start a project with m/ class I often start by 
saying, 'This is the project that we're doing and I have these things 
tat are non-negotiable . ' But these things are negotiable. I knew some 
of you wanted to change the project a bit or wanted to not attend some 
of the evening sessions so you could work on your project. That's okay. 
Your students should always be thinking how they can move the expedition 
in their direction so it more closely with their interests and passions 
while at the same time meeting their teacher's goals." 

When we start staking out those non-negotiable we are led into a 
fascinating discussion on the tension between being faithful to the 
demands of the profession, while making room for learners to shape the 
project according to their own interests. Time is running out and Ron's 
in favor of giving us the option of using graph paper. This is strictly 
a novice's shortcut; real architects would never dream of using it. But 
if we use this method are we coit^jromising our learning by failing to 
work within the standards of the profession? Why shouldn't we set our 
own standards, especially if they insure that we all succeed? 

Later, another issue comes up that raises a similar set of questions. 
Russann, the professional among us, feels that our project should 
reflect the kind of assignment that a real architect might be faced 
with. We're given a rough biographical sketch of a family and its 
requirements, the challenge is to design a house that fits the family's 
needs. It's a good workout; you have to get inside the mind of each 
family member. But some of us want to do a project that's more 
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personally meaningful, like designing a house for our own family. 
Russann doesn't budge. In her view that would make critiquing, a 
mainstay of the profession, inqpossible. Ron counters, "I know what 
Russann is saying, * If some of you are designing igloos and others are 
designing homes for the rainforest then we won't be able to talk to one 
another.' But I'm saying, "Wait a minute, we're talking about a 2,500 
square foot home for this hypothetical family, or a 2,500 square foot 
home for my family.' There's really not much of a difference. I don't 
think it's going to hurt our overall goal." Russann agrees. 

But the real spirit of this summit is captured by the many forms of 
critique — two people standing over a drafting t<ible late at night 
discussing the use of natural lighting — and the more formal sessions 
where teachers present their work to the entire group. One morning an 
exasperated teacher asks for help. Three people hover over her table 
proving ideas, encouragement and gentle critiquing. Before too long 
she's back to work. Throughout, questions hang in the air. How can I 
preserve a sense of intimacy while making nty house welcoming to guests? 
How can I create formal spaces for entertaining guests while making them 
useful to the family when guests aren't around? How can I bring together 
the natural world and indoor spaces so the boundaries between the two 
are blurred? In the end, it's these moments, and the care and attention 
to the work, that bring us together around drafting boards and 
blueprints, sharing our guesses, in^Jressions and our Staedtler Mars 
DunaGraph 10050 N2 Graphite pencils. 



<5>1994 Expeditionary Learning. 
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SKCBHOIOCT USK 



laapiamantatlon Zisvttls and Outcomes 

* Observations and 
interviews suggest that 
an active video culture 
has emerged at the John 
Adams New American 
School. A video 
coordinator supports wide 
availability and 
widespread use of video 
ec[uiFnnent; students 
produce a half -hour 
broadcast each morning; 
video recording of 
student work and school 
events is commonplace. Students produce radio broadcasts for 
local AM and public access stations. 

* The school has a large number of coiqjuters (con^uter /pupil ratio) , an 
Internet connection, and local area network. Students make frequent 
use of HyperStudio and Mosaic. 

* Technology use was the most frequently cited Co-NECT design strength 
in 1994 surveys of students and parents. 

* Teachers rated technology use as a very in?jortant design element in 
summer 1994 surveys. 



The Co'-NECT design provides i 
vision of & teciinological 
iafrastru.cture featuring unimpeded 
access to video equipmentf 
conputers and software tools for 
all members of the learning 
community, and a flexible 
comaainication network linking all 
coiiputers in the school with each 
other, and with coitputers around 
the world. 



TECHHOLOGY USE 



Research and Additional Observations 

The observations given above and described here are based on interviews 
with key staff members, parents, and participating design team members. 
Additionally, surveys of student attitudes were carried out in spring 
1994. Parents were asked in 1994 parent/teacher/student conferences to 
describe the strengths and challenges of the John Adeuns New American 
School; 21 teachers were administered the Co-NECT Design Questionnaire 
during the summer. 

In response to open-ended survey questions about the things they most 
like about their school, intermediate (29%) and advanced level (43%) 
students most frequently discussed con¥>uter and video technology. 
Likewise, parents most frec[uently gave technology as a school strength. 
In their ratings of the 26 Co-NECT design elements, teachers said they 
strongly valued the design's enphasis on technology. 

Observations and interviews provide additional information about the 
emergence of a video culture. The video coordinator trained students to 
put together half hour news broadcasts containing both school news and 
news about the wider community. Students develop scripts, read the 
news, conduct interviews, run cameras, and control the production. They 
also produce radio broadcasts for two local stations. More and more 
teachers are having students document work in class. 
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The usea of coiqputers are mainly tool uses, electronic comnunication. 
Mosaic and spreadsheet applications. There is some waiting to use 
compxitera, but access may be better at this school than almost any other 
in the country. A major problem in creating a con^uter culture is 
scarce expertise in the kinds of software available for schools and how 
they can be modified and used most effectively in classrooms. The 
technology coordinator principally has been concerned with hardware to 
date. As a computer culture evolves at the school, such expertise may 
develop among the teachers. 



I 



Adapted from Co-NECT Phase 2, Year 2 
Second Quarter Report, January 1995. 



TECHNOLOGir USE 



St u d ent Project 

Students in the Intermediate Cluster are in the process of developing this photo file as part 

of a project investigation on Fiji. The photographs of Fiji, were taken by Linn Gerrard, EarthCorps Volunteer 
to Fiji in July 1994. ^ 

The scanned images will be used for the creation of hyperstacks on different aspects of Fiji life, culture, and 
environment 



LPicture #1 

This is a picture of Earthwatch members doing a bio-diversity study and sorting out different plants inside a 
Fijian hut. 



I Pictoe #2 



This is a picture of the Earthwatch crew from all around the world learning about the Fijian culture and 
landscape. 
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LKcture #3 



Here is a traditional bure or hut in a Fijian village made of thatch and split bamboo. They have to rebuild these 
houses every three or four years. 




icturc#4 

This is a picture of the bush and mountain landscapes showing Fiji's rich bio-diversity. 




.Picture #5 



This picture shows the inside of a bure showing mats and tapa cloth decorations. 




.Picttire#6 

m&is a picture of a Fijian viUage showmg modem huts made out of cinder blocks, corrugated iron roofs and 
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COMPSKHKKSZVK STODENT AND PROGRAM CmCOUZ INFORMATION 



loplamantation Lavels and Outcomes 

* In 1993/94 the attendance rate at John 
Qulncy Adams New American School Increased a full percentage 
point from a baseline of 
94%. 

* John Qulncy Adams saw Increased 
parental Involvement In 
1993/94; we recorded 4,447 
hours of parent Involvement In 
Constructive ActlonsO. 

* Over 125 community residents 
pairtlclpated In or were 
affected by students' 
Constructive Actions©. 

* Over 30 business and non-profit Institutions were recruited as 
sources of educational experiences. 



GENERAL STUDENT AND PROGRAM OUTCOME INFORMATION 



Rasttarch and Additional Observations 

Attendance levels, parent and community member Involvement rates, and 
business participation levels met benchmark predictions. The already 
high attendance rate rose. Referrals for discipline problems decreased. 

Parents became Increasingly Involved in school affairs and their 
children's learning. At John Qulncy Adams, the principal remarked that 
"there is a new enthusiasm for leaiming . . . parents are excited and 
involved; they show a keen interest in the program and a greater 
willingness to work with their children's school." Parent responses are 
described below. 

Community involvement levels also increased. According to the staff 
resource specialist, '"People in the community are very interested in 
giving their time to help children learn about their particular areas of 
expertise, and they're very happy to return. They think our children 
are learning at a much higher level than most school kids they met." 
This statement is characteristic of the sentiment expressed by local 
community members who benefit from the students' Constructive Actions©. 

John Qulncy Adams established numerous partnerships with neighborhood 
organizations or institutions in 1994/94 — Including the opera. Natural 
History Museum local Price Club, Zoological Society, Museum of Man - Art 
of Ancient Civilizations, League of Women Voters, and local government 
offices and chambers of commerce. 

Adapted from Audrey Cohen Year 1 Phase 2 Report, January 1995. 



Audrey Cohen holds broad goals 
for improving student attendance; 
reducing retention, suspension 
and dropout rates; effecting 
successful transitions to work, 
the military, and post-secondary 
education; increasing teacher 
attendance and retention rates; 
and extending parent and 
community member volunteer 
efforts. 
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GENERAL STDDENT AKD PROGRAM OtTTCOHE IKFORMAVION 



Parent Responses to the Program f 

1 

On a John Quincy Adams School survey, parents' responses were 

'"overwhelndngly favorable and validated for us that we had chosen a _ 
program that makes a difference for all students." Parent comments on \ 
this school -wide survey included the following: i 

• *My son is much happier attending school." 

• *...Kids are excited about learning. . ." 

• "Students become a community within themselves; they care about one 
another and their community." 

• *I like the idea that all children have a Purpose and know what it 
is. They also know the action they are to take to fulfill that 
Purpose." 

One parent pointed to a special advantage that parents may gain from 
their children's community involvement: 

In talking with nty daughter about the Purpose of We Use 
Government to Inprove the Community, she gave me insight on 
the community and government working together. 1 am 
grateful for these studies because not only does it help the 
children leaim, ... it also pushes me to get involved in nty 
community . 

Parents also were pleased about their new role in the education of their 
children. This attitude was characterized by the following comment: 

The Constructive Action truly helped build a family and 
school relationship because it created the foundation for 
future relationships with parents and local businesses and 
this is something for which we are grateful. 
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smctoior or progress, chat.t.knges and recohmendasioms tor tutubs work 



Progrttas 

In examining progress and f raitiing reconanendations for reform at George 
Washington New American School, we adopted a model of school change that 
relies on the iit^Jortance of clear vision, the driving force of strong 
leadership, and the role of teacher learning in classroom and school 
inprovement. It says that change depends on a pervasive commitment to 
and concern with learning and student engagement. 

Surveys, interviews and ethnographic reports suggest that the 
Expeditionary Learning principles fostered school -wide cohesion around a 
unifying philosophy. Students and teachers came to understand our 
community's principals of intimacy and caring, responsibility for 
learning, and diversity and inclusivity. Students were active and 
conscious participants in the creation of Expeditionary Learning 
classrooms. They played an in^ortant role in planning expeditions and 
evaluating their work. Students were seen to feel both the burden and 
exhilaration of taking responsibility for learning. 

George Washington teachers felt that the design provided them both 
freedom and support for designing interdisciplinary curricula, focusing 
on meaningful questions, and embracing a pedagogy emphasizing student 
discovery and teacher as guide. Teachers said the design liberated them 
from stultifying instructional approaches. Teachers said the program 
enhanced their teaching skills, fostered teamwork, and provided for 
professional renewal. Teachers' perceptions that they are valued 
professionals and their renewed interest in teaching confirm the power 
of Expeditionary Learning's professional development approach. Teachers 
felt they were central bridges to school and classroom improvement. 

Challenges and Recommendations 

Next year greater en?)hasis should be placed on the full range of areas 
that need to be addressed in teacher professional development and on 
contextualizing professional development to meet the needs of the 
school. In addition, professional development should focus on the 
teaching strategies and skills required to help all George Washington 
students become successful learners. Staff expertise on these issues 
could be drawn from other Expeditionary Learning schools, as well as, 
from local experts. 

Our Expeditionary Learning partners need to tailor professional 
development to the different experience levels of teachers — veterans, 
inexperienced teachers, and teachers new to the design — all have 
different needs and require different types of professional development 
activities. 

In George Washington New American School, leadership was developed in 
all areas deemed critical to school change and was a powerful driving 
force behind the change efforts. Leadership at the district level was 
uneven, however; and the role of leadership in in^roving instruction and 
organizing support for the design and execution of expeditions is 
particularly in^jortant. We and our Expeditionary Learning partners 
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need to consider the character of professional development needed to 
in^rove and support leadership. ^ 

Taken (loosely) from EL/OB First Year Inclement at ion Report, 9/94. 'i 
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System and School Context Data 



Table 4 

Jamas Madison New Amerleam School Context Data for 1993/94 



Location-Type 


Urban - public 


Enrollment 


235 


Attendance rate 


89% 


Attrition rate 


new«62; left"59 


# Special ed referrals 


(35"lev 4, 15-lev 3) 


# In community projects 


50% 


# Returning staff and 




teachers 


100% + some new staff 


Average # applications per 




slot 


6 


# Conference dates 


3 plus shorter-term written 
progress reports 


Metropolitan Achievement 




Test scores (National 




percentile-stanine. 




cortprehensive battery) 




Grade 6 


41-5 


Grade 7 


27-4 


Grade 8 


20-4 



NOTE: CLC Narrative Progress Report, January 1995. 
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SUMMARY OF TEST RESULTS 
FOR MATHEMATICS 



DIstrlcl: WorR»«ii>r 
School: 

D«te Aprf . 1994 




PROnCIEMCY 
LEVEL 



Mathomatlcs <«| 
I 
II 

m 

IV 



9% 4% 

3.3« 9A% 

16X 13X 

2X 4% 



im. 1994 

m 16% 

8X 15% 

ox 0% 

ox ox 



lis i»4 im 

«ax Bx 

stx stx 

28X 33X 
7X SX 
IX fx 



25X 


20X 


S3X 


54X 


17% 


22% 


SX 


3X 


IX 


IX 



Staf % 

6X 3X 

STX 32% 

40X 47» 

I8X i4X 

2X 4X 



School % 
1992 1994 

20X m 



88X 
7X 
OX 
OX 



80X 
17X 
9% 
OX 




Below Uvtl I: 

Jome mu]Uple-«hotce questmnt cotrtcUy. 
Level I: 

^ ~' nutnctloil opeT«km». »«ch •> rounding nilh 
two^I»It mmbm and subtnctiim with bonowing. When pcottems ue ptescntod In a 
•TS? *ey «t rtte to p, brywd the simple reoognltkm 

S^"^^"* •'^'^ knowWr: to . coftecf wlutloT 

Thew itwfcio expctknce dinkuhy when «kcd lo create their own nspmx, however 

lli'T'tr* Jll?'**"'** " ^ P"*"*"" oomp^HiofMl proWeim' 

ZSLiIlL.!r"f^'^!^ ^"^^l «ramniaf conteMs *ey show ctalmal 
iindtiitndlai of bow ihdr coniputadoMt biowlcdte It reUlcd to ihe tarfu. 

U«d II: 

In f^P«R*e to nwWple^hoke ^uettioM. students at ihis terel show • good sense 
of miHihtr opcxadoni. can Inaslate both TerM and vIsmI situatlom Into nmnbcr 
Jenlaicei, and can wotk wMi siinple «)ccinni oretalions. They can solve one-step wotd 
*"<''*pW<^«e or dhrtskm and ratdllstcp problems lrm)Ivirg addition 
1" '"P? *'*^"*- Not only can *ey lewl scales and rtfrfa. but they cm reoosnize a 
itwmbk hlciTrciatkin ftwn a set oT pbvsibte options. 

79J5!!f »w»ess«*ens«k«ltoiespoadteopen.<naed ({ueitions. 

*^ Itittrpretalkws 
•T Iht data Dcfpite thrir ability lo perfbim loullne proMcn aolvinc. ihry aft iuMl>k 
to ^ *dr lmmlct%e to teal-Uft sitMtlont. TVb icsponses show evidetKe of some 
^^9^ *"* of the tasks Md mmbcr Kfisc. but these ttudoits scldea n 

ERIC * icce ptabk tnporm to tf« pwMegis pttsemed. 



Level III: 

SittdcDts M this level appear conndent h their ability lo xvork v/ith numbers H^v 

When respondiiif to open-ended queslSons, these' students leconrfze the >n«lir.«t~. 
of mathematics to everyday sitoaUom. TSd ^th^^Z^X^^ 
swefks. s»ch as eonitructins dianms. tables, and J^AM^uJ^ •PPWpOite 

•nswers. they e^perfcnc some dinkul^ in exprcssfng iheir teasonln^^ 
Level IV: 

J^^S^ f*T''"^ »^'* •« "«» eompuutkmal but 

^l^Srii Jl^^iL*^*^. .'^'^ they Aow « unSSTof *J 
mlSriL^^ """ctf W close attention to detail. «d M^Iy 

■ v«fcty of pn,Man,. TV, are neither dl,tn«e?2 

to m«^« the es^nS; 

tot tespome to the open-ended itmOoai, tfiese ftodents cfftctivdy eomiramicate 
provide Mly developed examples: censtnict stroeg, appropriate ai«imwntt: and , 
them to nclikv. . Ngber level of accteacy than it»d<nts In the ptevtou, level" 
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ASMMmnt 



SUMMARY OF TEST RESULTS 
FOR SCIENCE 



10: 348276 

District: W<Hces>~- 
School: 

tMK AprtI, 1S94 



PROFICrENCY 
LEVEL 



Selene* 



<l 
i 

n 
tti 

IV 




Sctiool % 



3S^ mi 19^ 1S94 

41X S2% 59X B4« 

34X 45X M ats 

1B% iB% OX $X 

2* 4X OX SX 



Special Needs 



Stata % 



School % 



ma 1221 

11X 8X 

49X 47X 

27% 38X 

11X 8X 

IX 2X 



t992 1194 



Btltw L«v«I I: 

Vn Twpomcj orsiud«tttJ In ihh riieitoiT prorMe IwunJdeni infbtniallon to 

eviJuitt the^pfoRcjcncte. llotvr*«. siwknts in thli caters «t ,ble to amwtf jome 

Lt«il I: 

Stadcno at thb levd vt (kminar tvllh ndctXIOc Tkh tlm (bim part of cowmen cxpetlencea 

Ti^ 1' *♦»!'**"*• »«k*Wo«. rot tnmpte, they know t(ui betn 

hibetnatt dwfog tht wtnler. 

Tliq' «wly a iwctfcti loftc to at«n*«i{tic Mjlliple.<lN.k« quertim that arc placed In simple, 
cvffyaqr conlextf. TVy (upoml well to rroMms that uae vhml tkmcins or illtMratkms* 
kunpreftit mmp symbol*. ot*Hrf a vfsod leqoence. and nwtht timpte papte. 
Mj!li!!!!!r^J!^y^*^ qoetUona. attRknti dbphy a fraip of (kt$ H rario«« jcJcntHk 
rtK^imo. Thty caB make ilmpte otactvaCJonj. the, itaon to xcncral ractoal ii«w«<te<lte 
^ ^ J^'^' ^ •** «e<jiil»t»««» or the tadc For c^rnph. when ttked for tlmUanlUs 
* •*»!••»«'•'» *ey WetmOed vtiy IHvW and obvloas 
dHftfewtf Mfch ts a tnc It taf |er than a dot w 'w*rt.' Tlirir anaweia cHcii apiicar tncomptcte 
becaMM of poor naaoQlny mOs, hdt orcx*«|>la; an InaMlhy to IntetpttdWa. «id • trndency 

to IVSMS tfw fail. 

Itnl it: 

Siudei«s al thU kvel bc^Jn to recofinlxe fooie reiuUihy In tht wM. Thty undentlmi 
the nttd lor wkn^ifk ptoctsses, wdi w objcrHnR and cclkxtinf dtu rrhcn conducthvf; an 
cxpertine*. Cotnpattd with itudenH M Ixvd I. Ibey alnw a pcater ability to tfip\y theft 
ktwwMptocvahateatdoroptiMtt. Thdr factaal ti wi > l e la demowtTBted by the mnMpto. 
cMct iMdu. 

In awwcijt n opcw-ended qacstloM. attidctaa display lirt-bMed knowledge stiengtbciKd by 
mm MiilMlliuiiltM and «ndci:la«llnt. TVyartaetmteebKrmabuttcndtadeiictibenthcr 
tm latetpiet «fc<a. They Make dircci «noclallona widi caac bat BJler al yndktint long-na^e 



Transitional BNtnguat 



Stats % 



School % 



^ iSH j9S4 

31X 23X 

53X S7X 

tax lex 

4X 2% 
OX IX 



other 



stata % 



mi mi, 

4X 9X 

39X 30X 

38X 47X 

19X 1SX 

2X 4X 



School % 

1992 1994 

3tx ex 

89X 54X 

10X 9tX 

OX 6X 

OX 3X 



^**!° wmlruet an txpeHment, ihete itndenta do mt appear to lecotabe 
Aj^fbr «6 mnltlple trtab. TWr an™ mt mlnlm.1. laO^^^iboSS 

l-errt 111: 

.-i!!'*^ ** ^IV^^^ ^ ' ^« Their feiponxs tumjt 

oT^dortHkconcept^ For exampk. ll«y ,,«ognl« -«d undenland the fanetfeTofv^ 

SKfS'lliJ^SilC'^Sl'^ tinnt art f data about** 

WrrnetJlz>d*^«deorK 

in (ludcnla rtnaln «ithfai 9» confines of the ^nkxi and do i«e( claberate a gmt deal 
Level IV: 

Stodoita aiAh le»tl po»m .dentine and practical MbrmUton that toet beyotd «hit thw 
S^jlJS^'il'aif*'^^!^^ InmponaeTthemali^S 

ftriMtaaoiiint aWIf mott than alo*^ 

SiSSrSiil^^ W«TH-e know W|. to demoma,^ m 

ineirawTO dcnMUHaie 4t|Mh of «ndtrttm)(n« ei «el as elaboration. 
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Massactiusetti 


SUMMARY OF TEST RESULTS 


Oistrlcb 


34827S 
Worctster 






GdUnlonal 


FOR SOCIAL STUDIES 


School: 
Date: 


AprV.1994 


Grado: 4 



PRORCENCY 
LEVEL 


ALL STUDENTS 


Student Categorise 


Special Needs 


TransRionaf Biiiitgual 


Other 


Stat«% 


School % 


State % School % 


state % School % 


State % 


School % 




1992 


ISSi 


1992 


1994 


1992 1994 1992 1994 


1992 


1994 1992 1994 




1994 


1992 1994 


Social Stxi<nes<<| 


T% 


4% 


41% 


10% 


1$% 10% 


39% 


24% 


8% 


3% 


38% 11X 


1 


97% 


34% 


53% 


S4% 


47% 48% 


44% 


S5% 


39% 


32% 


S9% SIX 


II 


37% 


45% 


3% 


26% 


28% 33% 


13% 


17% 


39% 


48% 


3% 28% 




17% 


13% 


3% 


8% 


8% 8% 


4% 


« 


18X 


14% 


3% 9% 


L 


2% 


S% 


0% 


3% 




0% 


1% 


1 " 


5% 


0% 3K 



Bckm Lt*tl I: 

The open-en^ mjionjes of stu<Jcno h thta rilrgtny |iro>Me insuffictent Inrormillon to 
CTtlimc (hch (nottcicncics. Itotvever. stadettts in thU ctteKory able to inswet tome 
mutl^te-chokt i|ucstttms coacctty. 

titVtl i! 

Slitdenb •! this IcveJ pctform well wlwfi orr prestfitcU •Isually. 'Ilicy tan use simple 
Ictya, n»4 gnpltt mWI mt^. ind combine Ifiremtttion. AkM by > pictuic. Ihcy Rcotnitt 
timllMMct md dilTemKcs. The; can recotnize t}ic conrcl option rrom s given mi. Although 
they have a tton of general kno^ieilge, iliey appear to hkve limlrsd (nrmmation about the !«r|er 
«rotM. CfauToom c]i|«ttence 4oes not seem K< letntcSatc this. 

Vhtn w a w e rfcii; opett-entlcd qatstlons. Level I iMtoMS icspoml supcrnclntly with llmiietl 
Intcrprctatten vT qwctltons perlatnlnt to commufilty. vottnf . atnl chtrmoliif y ot° hiMoric cvent5. 
Tie; mattnuoi what rule* arc but txH vrhy they exist. While Level t studcnlt rtcofitiTS dtnertnl 
gtOfiapMcil regkrm, Ihey have diflicMltjr aiticiitacin| ttt tfifrerciKes. They know the vocabulary 
«r »ecM ttiidta, but art not atwavs able to lae thai vocabulary appropriatciy. Poor rciiding 
iltnit aflbct their abWty to answer. 

Level lit 

StiMktib at Iml 11 gmp the bcsic content pmcnted In an c1cmen1at> Khool curriculum. 
The; em clauirjr people accoiding to their role*; hiTC some knowledge oT American cutlural 
tlvcis^jr; Ml imdentand ceiUin ccommic cowxptx When ^vcn ■ let of options, they cm ttason 
tbiHA the Inronratkin to dbltnintsh fkct IhNii t^nion and ptacc events In dironologlcil order. 

Thtir epen-mded re ipo nsei generally rcmahi personal and concrete, foctising on how ibe 
««rM tfActs ttcin. Level 11 students etM select peititient details finm lung pamages arid 
CCC H tewlly cvahiata those details as tvklcncc. When allied to compatt and contrast aaodem 
mi talanfail IHdiens aalng pktura, their sntwct^ apikt. arc concrete. Hmlted to deitlU shown 
Q <fa la die pietMRS rather thsn ushig thera as springboanb to larger tonccpts. They recognize (he 
^ ' ' iRittta ff change but camot determine the nuscs. Ihcy have some ability to tead mapa and 



can identir« some attributes ordifTerent sites. Unlike Level I itadents. they can ansvaer a muttipm 
questioe with same eotrectness. 

Level III: 

Stadents it Le»el III nre more aware of community and lerclsor government. They undcrttand 
some major concepts such as needs vs. «vants snd cause and. tflbct. Thr\- ace diittinguithed 
by their ability 1o cviluatc informalian to identllV the best tesporue Ihrn • get of 
plauiiblo cptlcns. 

In their written responses, ihcy eahlUt an objective point of view. They comprehend htmtM 
geography- and ^ave a sense of chnmotag)*. They tmdostaad the eataes of change. They can 
imeipict data but cartnot draw inTerencts based on the data. Nat only d9 they select and evatuite 
evidence. h\* they me It «> Sopport positions. Student! at this level ivcognlise that there may 
be moit than one proWcm-solvIng strategy and that each Strategy h«s advantages and 
disadvantages. Iltetr anstven are vdequalc but lack etaboradoa and lack examples thit enrich 
the responses and d c mon s t t aSe strong ;reasoning sUlh. 

Level IV 

Students at Level IV show clear reasoning abtSty: They an skilled at inferring tnm dsts. 
tccofnidng tssumptlore, and JustiO'ingtheh responses. Their knowledge of histoty goes beyond 
benchraatic dates and events: they mdentsnd some taidolying Mstotfcal cunmls. 

When consttvcthig o^ettdcd responses, students at Level tV combine Strang critical tMnldng 
tUIlt tvith signlfkanl prior knowlcdte to feMctale logical. wci«ippof1e4 mwets. They go 
beyond Hm simple iet|ui(cnMRts of the question by synthesizing diverse hfilbtmation snd making 
mcaningfiil gctmaliratictu. They cin CNgiatce an4 Intcrpiet data to make oongwlsoiis. d/iw 
inrervnees. and arrhre at conclusions. They discern subtleties stxh as kony and aoclsl latite. 
Ihcy kn«w cantmt events and can discuss them cogently. 

Their ans^via mt elaborated and well supported with evidence and appt«priate CMunplrs. 
They display depth of (bought and la ideistandiiig. 
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SUMMARY OF TEST lESULTS 
FOR WRITING 



DiBtrlct Worc«»t«r 
Schooh 

Date: April, 1934 



Qrade: 4 



J 



PROFICIENCY 
LEVEL 


ALL STUDENTS 


Student Calogorie* 


Special Needs 


Transitional Bilingual | 


Other 


State % 


School % 


State % School % 


Statt % School % 1 


StaHi% 


School % . 


vrrltlnti 






1994 


1992 


1994 


1992 


IIH 1232 mi 


1^ 


am jasa isii 




1994 


1992 1994' 


<l 


9% 


7% 


91% 


V% 


10% 


13% 


2Q% 


22% 


6% 


e% 


22% 0% 




1 


28% 


a4« 


34% 


54% 


39% 


44% 


38% 


43% 


26% 


33% 


37% 67% 




II 


49% 


42% 


31% 


31% 


41% 


35% 


33% 


28% 


4S% 


43% 


37% 29% 




III 


10« 


U% 


3% 


15% 


11% 


7% 


8% 




20% 


1S% 


4% 14% 




!V 


4% 


S% 


0% 


0% 


1% 


1% 


1% 




1 " 


2% 


0% 0% 



Bdow Lcvd I: 

The optn-«ndcd responses of sludcnts In thb ctltgorj piovlde InsnfTkient Infonnalion 
lo evaluate their proficienctes. WHiing It not assessed using noltiple^hoicc qoesiions. 

Level I: 

Sladentt U this proficiency level are no< able lo comniunicMe with the rcidcr. Tliey 
appoacli the tasks as they would a vvodshcct qucition. AHhoofh itio-ani. their tesponjcs 
lend to be ndnima). uitnlty limited to a single setiicnoe. If they «ne more tlum one scntctKO 
or there Is no attctnfil to connect ihem in foflcal aequence. Idea* are expressed 
in vagtK tctmt vdih Texv ipeclfic dci»il<i and IHlle etnboriiicn. 

The tesponsea ol siwlcnls In l*ircl I exhibit a di.tpn<poHiona(c nwnbcr of etior* in 
surface rcMwcs (spelling, pMKlMtlon, eapltatintlon. and Mtdfe). These errors may be 
so nunKToas as to Inlctrere tvlth tht teadcr*s ability (o undcntanJ the text 

Leetl II: 

Smdcnts at tWs i)n)llcteney Icvd are aWe k» achieve baste »kttt1e« communication. 
They go beyond the simple one^nttnce responses that eharaeterixe students at Level 
1/ TtKir paiapaphs show ludimcntary development, eonslsthti of predictable, simple 
sente«es with uncIabora«ed or repetition details. Thet« is some attempt at ortaniwUon; 
iNnvcver, IradHionat oTfani«itional ieatures. stKh tn topic sentences and conchisions. are 
mis$in|. In their argumcMs, these students attempt to show a prognssion cT thought, 
but thtf« are lapses or shifts hi higical devetopimnt. Like students in Level I, these 
studenb tne very simple lanjtinge that h not always appropriace Tor the topic. They 
havt not Mqulrcd the notion of Tonnal lanttage. 



In general, students at Level II display more control over the mcchtnlcs of writing 
than sluderts In the lower levels. They lack sJdlb in the areas of topk development, 
organlrallon. ami detail. 

Level tlh 

Students at this le»el ate beginninji to show a sense of audience ami can adequately 
commttnicole their knowledge and Meas. They respond to qaestlont with a topic settlctKe 
and go on In develop their Ideas sufHckMly. They use complen acnletKes with predictable 
stfiKltires. They have an awareness of paragraph Rmwatlon. but lack complete command 

These students undetstand the need for support and provide details ippropriaie to 
their conchisions. In sdfHion. their writing involves imctpretatlon ts %«ell as exposition, 
tignallns the beginningf oT abstract Ihoaght. 

Some errors l« surftce Icatates are Rxmd In t>cident9* tvork. \M they (to not Interfere 
vvltfi the reader's afelU^ to nraSctsland the text. 

Level IVi 

Stutetits at tMs ptoriclency level communicate clearly and elTtetlvely with their 
audience, expressing themsehrea with a sense of style and voice. Their wmk shows an 
efTvCtirs variety of sentence sHuetute and lei»glh. They support their mita Idea with 
Interesting and peillneni details and ridi langaage. Their transitions, not only from 
sentence to sentence. b« also ftom paragjapti to pamgrapK are smooth and teasonabte. 
By csbblistiing and nuliKaining a ptitpose. these wtllets ceastruci a logicti progression 
of ideas Ihjt leads to aophisticated conclasions. 

Some Rirrace erton may be fowid, but ihty do not detract from the writer's ability 

lo COtfVtNHllCfltC. 
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SUMMARY OF TEST RESULTS 


lo: 

District 


34827S 
Worcester 








FOR READING 


School: 
Date: 


April. 1994 


Uratte: 8 



PROFICIENCY 

LPVPL 

t.i*. V Civ 


ALL STUDENTS 

* 


Student CaAegorles 


Special Needs 


Transitional Bilingual 1 


Other 


State % 


School % 


State % School % 


State % 


Sctioof % 


State % 


School % 




1992 


1994 


1992 1994 


1992 1994 1992 1994 


1992 


1994 


1992 1994 


1992 


1994 1992 1934 


Rtading <| 




tOK 


t05( 


29% 24% 


35% 


29% 




12% 


8% 


10% 


1 


am 


30S 


35% 


40% 43% 


28% 


35% 




28% 


29% 


35% 


n 


26« 


33% 


30% 


19% 23% 


10% 


20% 




27% 


34% 


30% 


HI 


24% 


14%- 


20% 


10% B% 


15% 


G% 




25% 


15% 


20% 


IV 


TK 


13% 


5% 


2% 4% 


4% 


7% 




7% 


14% 


5» 



Bttow Lcr*l I: 

The ofKV-ciKied tcspofms of ittudentt in Ihix celegonr provide imanictcnt inronnMlon 
to etaluile tlitli prondnKlcs. HwT\cr, slwletits in thii catcfory we nble lo anjwrr 
jomc mtltlple-clwice qocslloits concclly. 

Lcvtl I: 

Students at iils Itwl pcrrom* vrcll on nniHlplc-cltoict <|uc5t!on) Unkcd to Mgh-intcresl 
inrormatiotw) pantfiet xwl »lKnt nmativet. They an aNc to gnup the main Ideas of 
luch ptSMSBl and to locate InTonnation vvititln the text or closely triatcd to H. Tlie; 
can fccognixc simple Inrercnces that are based on general infomtation or conimon sctisc, 
and can distlnfi^ between clearly dematested facU and opMonf. 

TJte»e itRdcMs experience mote «flfllculty when asked lo generate their awn respomex. 
Their msmn are typfcalty literal rather iban analytic, telling dictetly to facttial details. 

Urd It: 

^t»de}iu «i iMt level ate able lo evaluate « Mt of ptattsibtc multlple cholcc opikms 
and choose the best fciferencc aVitrt character and mollvalioo. They can also dilletenliale 
atmmg tutcmtnts that hold similar mcanins and can idcnliiy Judpncnts based on evidence 
pictentcd in the passages;. 

Ttiey are less succcssM when presented with an open-ended question. Understanding 
and cwimwnicating the literal is a hallmaflt oT responses at this level. Sladenls may 
be able tn Mcntliy the tone or theme of a passage, but they arc not skilled in atalysls 
er persusion. Slaiilarjy. infonnallonal mslobl Is reoro accessible to them than Is lietioa 
(patttcatarly fiction Incorporating satire, metaphor, or other llleraty devices) or poetry. 
Si«« Iht^ p«l » dimcttit to recogntw wwnces, ilicy do not go beyond the lltetal. 



er|c" 



Level llh 

Students at this level n«e able to go beyond the literal to constract meaning rroro 
tlie lest. 11<ey apply tensonlng and prior knowledge lo dmtr Inrerenccs. 

These students ue also able to distance tbemselvcs fiom contetit and begin to Judge 
the crall of writing itrctr. For example, in icspoiMc In multlple<holce qtMStkxts. they 
rccoftnize why a ptitletilar title was ehoaen. the (bnctkms of selected parts of a pasn^c 
in cottfriiiuling to llie whole, and the furpote of certain fonMrt conventions. They are 
able lo tceogniM the tone of a htimoious fiibte and to kfentiiy dlill^ent types of lltcratute. 
When prewnted with mote sophisticated genres ftKh as parody or satire; hoivever, they 
Tail to recoffiiie the hmtnar or the maltiple levels oT mcaalng in the passage. 

Tbek tcspertses to the opcit-«nded qttestlons ate teasonitTic and coherent Their 
Qpproacn Is orderly: however, it tacks nineient analysis or detail to mal^e it convincing. 

Lttd IV: 

Students at this level aie distinguished by their ability to reason md Tomi Judgments 
in a range of allaaiiotts. la tc i p on ae to nwltiple-cholce <|aesltoni. these sttidents eotild 
correctly abstract meanlnf. draw conclusions, and nuke Infetenoes. I^nny ipiejtlons teqtrire 
tratotv Judgment and tint dise ii nt i im km to choose the most comet response ftota a 
SKl of plaMsiMe options. Others leqttlte stiideats to apply the Ideas presented in the text 
to other contexts. 

Students at this level exhibit t tnott sophisticated andetrtandtng q( the cmfl of writing 
than stadcnls at the tower levels. Not only art they bmtliar with stylistic devices, poetic 
forms, irony, and metaphor, they also show an u n d a s t a ndint of the characteristics «f 
dllTetent genres. 

In their own writing, Ihey eircctlvely orgsnine materials and easily f enerstict froai 
speclflc textsal cximplcs to mote abstract and Inchisivc themes. Their vocabulary is 
extensive. Not only do they show an ability to teoognbx aoanccs In the meaning of 
words (e.g.. Immediate versas andcrlylng causes), M they ase that andertttnding in 
their discassion. 
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si/jw/w;»f?y OF test results 

FOR MATHEMATICS 



lu: 


349276 




DIslricI: 


Worcester 




School: 






Date: 


April. 1994 


Qradv: 8 



PRORCIENCY 
LEVEL 



Math«tnatic9 <| 
I 

ti 
III 
IV 



ALL STUDENTS 



School % 




1992 



Student Categortes 



Special Needs 




School % 



1992 1994 



Tnmsltlonal Bllingval 



State % 



Other 



School % 



State % 



School % 



1M iSH Sm 19£1 

t8» 21% 

42» sex 

20% 27% 
U% B% 
6% 6X 



1992 1994 

7% 9% 

Z7% 34% 

aOX 39% 

20% 1S% 

6% Q% 



1992 



BtUw Level I: 

The open-ended resporacs of students fn tHt c«tegot>' provide inMmciettt inronnaiion 
to cvaltuie their proficiencicj. Howrvtf. students In this cvtegor)- are »blc to •nswer 
tonK m«Jtlpte-«hotcc qucitttons conectly. 

U«d I: 

SiudcMs u this tcvct rccnpilw (tie muliK or ha.<ttc numcrkat iipenlions nlih whole 
mimben and some types nf (Vactlons (e^t-. «ttbinclhi0 lhic(loi« with ct<«tttTK<n denoral- 
naton). The; on ldcntlf>- the concci epenlions miuinO by simple tvord prubleins, ste 
Cunllttr with seme geomdrie tctms (cf., diameter), caa identiry common plane figwtcs, 
and can read {nrormatkm contabcd in charts and hit(o^ams. 

When presented with open-ended questions, they a|>ply a Itlal-ind-enor strategy b> 
soKIng staiple proWema. btH espcrlence <9nicuUy In intci^mting probletns presented ht 
•ntoiltlar IbtrMts or contexts. 

Uvtt 'ih 

Siadetib nt Ihi* level have a basic tndtntandlng of Ae nometlcal skills and concepts 
(hat fotm the btsb oT the cktncntaiy fcbool ctnrieulma. In response to multtplc<1ioice 
^wstions, Uiey can recognize the tesohs ora wide range orntanerkal opentkms involving 
whole mtmbers; decimals, and ftictloni, pitiented as computation or word probtetns. 
When given a set or options; they recognize ttM correct cvahtations of various expressions 
and ttK centct use oT Tonnatas. This svggeits Oial they are beginning to acqvitc the 
lUlb nectssaiy Tor algcbn. 

When ptcMnted wirti more challenging open-ended questions requiring wiwetical 
ictMRiag. I]n7 are not dependent «n fiMniUir contexts. For example, they andetstand 
tfut the size of tfw prodtKt or stitn oTtv** acts of mmbers h dclamlried Iqr tie aitaogetnctit 
•r iit dlftti le each la Although thty m wrilling to attcniA mnmitlar or oomplex 
Hu bl tiMSt they eOen do not rcccinbs the rclallonahip between the dements Involved. 
In w sp oe dtog to questions, they llnd it dUIIceH to cxpiesa ihcit itaaoning. 



Uvcl III: 

StiMfcnts at this lerel tcspond well to ({tiestiont h a mwWpte-cholce Tonnat They 
exMWt a thoroogfi btofwlsdie of numerical o pcrattona and some u ndeis t mdlng of more 
complex ramcrical concepts, such as area and perimeter, ractofing. and ratio. Beyond 
this, they show confidence in tadling problems ihst are as dependent tipon tcaaoaing 
as they ant upon computational profkiency. They an also famlltar with the tesa-tradltlonnl 
topics of Iht eighth-grade eurricuhiRi. such as probahltily. They rccegnlK the use or 
vatlaMcs and ate generally more sophtitlcated in iMr use «<r cymbolie hnguage than 
stttdenu at Uvet II. 

y/hm asked to respond to the open-ended questions, these sttidenU ondetstsnd the 
ttqtilfonema of tfte ptoblemi and woke good aitempti at loJutlons. When prtMems are 
stralgMlbrwaid. auefi at interpreting and synthcslidng data flom gnfittt mi charts, they 
are able to foim tcasorablc conclusions. Tliey find It ditTlctth to organize complex data, 
bov«!ver. and utaally Tail to consider aome Import^ vari^lcs. 

Levdl IV: 

Students at this level an knowlcdgcaUt aboM a whfe range of aiadxanttieal terms 
and proocdwcs. Their wtdentanding of ntttKnatlcai algodthms «id concepts goes beyond 
recognition to nggest a ntach deeper kvd of undentanding. When pctsented with open- 
ended (piesttoat, tiKy can perfbnn complex tnanipuiadons with numben in order to solve 
problems, hi the field of geotnetqr, they know the necessary attiibetes Ibr sech licnits 
as pannelogtams and dnilar trtinglet *nd can itoegniee nmlfipla lines of tymmctiy. 

In addition to Ihek nwxtical proflckncy and gtonetrfe ttnowtedgt. tfiese stodcnts 
display a wen-wdcrcd, reasoned approach topnbleni sehlng. When presented with complex 
word probkiHt. tliey apply a variety of aointien stiKegies; Indadlt^ the oipnizailmi 
of data into chaits end giaphs. Hot only do dwy imdctstand and ose sppropriale symbolic 
le pt M i e iit K ion. iiey can explaia thdr leasot^ wift clarity and 
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St/MMAHK OF reSi RESULTS 
FOR SCIENCE 



ID: wears 

Olstrlcb WoTMstor 
Schoob 

Pate! Aprtt. 1994 



Gtnidfl! 



PROFICIENCY 
LEVEL 



Sct«tice 



f 
II 

m 
rv 



ALL STUDENTS 



State % 



-1>92 1994 

7% lis 

ZB% 24% 

24% 35X 

27% 14» 

4% 9% 



School % 
1222 1994 
10% 
30% 
4051 
20X 
OX 



Special Needs 



State % 



School % 



JS2i 1M JiSi 
14X 22% 

SOX 43X 

20X 20X 

14X 7X 

IX 3X 




Student Catagortos 



Transitional Bilingual 



Other 



Stele % 



School % 



State % 



3m. im 

17X 26X 

<0X 35X 

17X 25X 

17X 8X 

3X 3X 



School % 



J292 1294 



1222 
8% 
37X 
25X 
28X 
5X 



1934 
10X 

asx 

36X 
1SX 
7X 



1992 



1994 

iox 

30X 
40X 
20X 
OX 



ta Kp>omn of itudenu in (Ms ctegory proWde hmHkkM tnromrtloo 

^r^ J^^ ^ P«»ficI«K «. Ikn^w. rtudcu i„ uilt wtegoiy ve able to snsivcr 

Unl I: 

K^fi*^!2f* 'iJiT'' '-iT •'"7 »*'^'» of ev«o-day lire, ,ucl. si p««on«l 

hwiB) md Rotrition. flMry wMlmtaixl some nmdamentil conccpu.. «tuch at the fimctlons 
or vMiow pim of the body and the claHincatloti of Iiv<n| thingj. When si^en n simpk 
experiments jyttctn. thty rtoofntxe the b«stc cempomnti of Ktentinc procedurej. 

When ptcMrted with an ppen-«mled question rctiulring experimenuJ design. Ilicr 
netUiCT itcojnite which voriaWe* mutt be coBtroIIed m»f develop «IId scientific 
pracedms. Tliey refer to familiw issues such as the en»JronmenL but cannot ase ihat 
fciwwiedge to generate a cootct lesponse. They experience difUcuity (ti intetprctint the 
rcquinunaiif of Ihe tasks. 

UtiI lit 

Stmimt at this level are bccomins vnr* ofihe reiationstiipt jrniong bulc scientinc 
r P*7»'"l sciences, Utejr cm idenliiy the practical cOecU of condensation 
■ndci«fm(ioa In lift idetKei. Ihey show some tindeiitanding of the food chain. Given 
mttt tf cptiom, thej can Wcntifv a togtcal conchislon (hat ca«ld be drawn Tnm a let 

*5:_J^ *^ itcogniie a tittntloa vrliere sampling of data I* appropriate and 
can idendQr relevant data-gaiheiint ledmlques Ibr a research qoeition. 

T h«y cxp ettence dtdlcuhy when asked to do more than rtcognlre a correct option 
(l.e., cmtiud their own response). When prcseirted with an experimenlaJ situation 
12 iiLIIf^J'' '^'^ " *^t^ Tlicy cannot apply the scientific processes 

tiKjr Mtntilkd m iiitilt!plo<hoke qimtkwii. Tliey use a fhcn set of dau to JwUl> obvioai 
■ml In waerBtH eonchwlom; rather tfian orgatiking ttie data to reach a more reasoned 
feitenliaUoa Altfxnith they ttcognize getwtal prtoclples. Ibelr analvtes tend to be vague 
IM tWr mpooan minia»l. with littk or no etphaatlon. 



Level 111: 

Students at this level show a deep«t understandlna of icienKrk nmcen« U .~.fvi— 
«hem 10 a Tariel, of sitvalions in «ltotnt conteS ST^cS^^oSfi 
•PpllcaNe 10 rtal-twM rituatloia (ea.. use of solir MnlT^^^^ 

or inrotwation thai might be relevant In answering research questloni and f«-«ir.iIZ 
Kl:r^' orexperimenui enor. Given a k, So^lZS^lS^^^Tc 

tJ^l^^lliJl^T'^ competent responses. Ther are knowledgeable abotrt 
wperhnemal procedure and can produce a tatislk:lor> experimental dcsltr T^v 
wgsnte raw data to reveal relationships btit cannot dravMnSes -Kir ™^ 

Lrrel fV: 

^I^*,!r"I.?"*.'" •norganlwd body of knowledge end a gr»P ofjclentinc 

between volume and the tnnsftr of heat, tod the efftds of nM»fc*nl^fn»w.««f^f 
wHh ati experirnenlBl situation, tltey can create a well-ooncelved design Their exntanMion* 
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SUMMARY OF TEST RESULTS 
FOR SOCIAL STUDIES 



10: 34827S 

District Worn*«^«»» 
School: 

Date: April, 1994 



Orade: 0 



PRORCIENCY 
LEVEL 



Soctal Studl«t<| 

I 
II 
111 
IV 



ALL STUDENTS 



State % 



School % 



im mi 

22% 15ft 
S% 7% 




Student Categories 



Special Needs 



State % 



School % 



1992 1994 

ia% 23% 

53X 47% 

18% 22% 

8X 6X 

IX 2« 



1992 1995 



Transillonal BHingual 



State % 



Scttoot % 



1992 


1994 1992 1994 


1992 


2931 


1992 1994 


23« 


27% 


7% 


0% 


10% 


44% 


35% 


38% 


32% 


25% 


15% 


21% 


27% 


30% 


40% 


15% 


9% 


24% 


16% 


25% 


3% 


4% 


5% 


7% 


0% 



Other 



State % 



School % 



B«i«w Lrrcl I: 

The 0f)cn-«ndetl retpoiiMS or sttKiciils (n this calegonr pfovidc imulTlcicm Inronrcitlon 
lo evtJtaite Ifielr prolkkmriei. llo**c*cr. >(V4l«iti in this catctory trc «Wc to aniNw 
same mulliple-choloc qucstbns eonectly. 

LoH I: 

Students at thh level ctn rcspomi to nmltlple-cholce questiotia that depend apon a 
knowledic or bask tcpks, such aj the duties and r)|hts of dtltemMp. They are abte 
to identity major Amcdean tutesnen widovt establbhinf their historical context. They 
txpeHtoca dinkalty In c oimir e h e n di B t lh« causes and cflkcls of hblorical movtomits 
and In apfAyhnf their tkctval knowMfe In vnlhtnltSar contexts. Oi«cn • map. they ait 
motble to dcaw InliRences concernhif geo ti aptilc or ccoaotnte rcatutct. Their Inowfedgc 
appeals to rcnoaht at the laothC* level and their judfinent is basically h terms of 
absotatea. 
♦ 

Lard Ut 

Stwknts at this level display a lenerat knowledge iboat the vyotid beyond the 
classroom, eonectly aniweiing ^nllfip(e-<^loke qttesttons deilin| «rith the eavironment, 
cwTcnl events, and WoiU War II. Furtfrnmoic, they afipear to retain and i wJ e n t an d 
the UujfiA c«n{ctiltMi 

Tfiesa tlitdeaCs can make simple Itiretences ftom graphs and charts and can Mentll) 
thf Ricisatcs carried, by political cartoons. They idso show a ramilimty wWi place 
Hompl iy, faceesslMly locating the potHtoe of cities and itates within tlic United States. 

WlKa ^ven a set oroptkns. they can identliy the meat plausibie condasion, dlstlti|«lsh 
bctwcta bet ml opirion. itid geneialice correctly (hmi a Kl of Ikts. They otpetktKe 
Data dllQcatty wlicii asked to constntct in argaawat on their own. In response to open- 
mM fiattpof, ihqr tlad H bmi to coashfcr both advaiMecs and disadvantages of a 
litiatfeiv wd ifipcar to lack the neccssaiT inlbnnation to malcc a convinctng atgumcnl 
In a mnibcr of aRat. As a lesall. tbek censtractod responsa tend to ladi clarity and 
<«wkHwi> md m typicrily cbaraetertetd fcy their bwvity. 



t^tt III: 

Sludcafs at this level are able to go beyond the ftcts and taught iktlnliiora of the 
cattkulwn to rtcogr^ tlK underlying eenocpts ITiey arc Ihient readers and can read 
and htetptet graphs ht mnimillar formats. For exampk. wlien presented with a technical 
chart containing economic and aodal statistics (eg.. gto» national product, infant 
mortality, students per InhabitantsX they can Inletrate the tatlbrmatton to make some 
valM tnlhcnces aboot the coontrlts repiesenled. 

WHMn the mohipk-choiee fonntt. tbcy caa ttaermt and evaltaite statement* by 
spotting tapscs in toglo and inconisteneies. Wtwn asked to tonstrvct their own responses^ 
they caa atnicttBt aigt wr xa t s aiMl recogniM coatrasting per sp c cUm when the aukrial 
Is GanlDar to them (04^. cnvkonmeaial Issues). In response to tesi^iliar lopks 
(comparltens of ttligtons. Ilio catises of immigrations, tho impact of the Sovkt break. 
upX thdr bek of detailed knowledge ihnits the ctlbctivcncsa of their argumeats. 

Lcvd IV! 

StttdenU at this level display a wide ttnge of detrilcd htRxmriion aboot present and 
past sockttes, as well as an taidcrstanding of historical telationsliipa. Althoai^ their 
knowtct%e base extends fkr beyoad the sodai stadkt canfctdom. their most typkal 
dmctctistk is thdr tendency to go beyond the spedlk Acts to comldn tmderlying 
Issoes and concepts. For example; when disetssing a cattoon they im ahte to relate 
the cartoonist's message to the larger socM and cthkal Istaes tfatt h rtprescnts. Stratlarly. 
when presented witli an histarical event, tliqr art aUc to desct%e in detail how the 
same eveat oordd be Judged dilRtcndy wImr tlewed Ihxn dinfacat Mitorfca] pci?pocttves, 
Asked to revkw a move carmtt political ritiaten. they can die both positive and negative 
argtnier«i belbre coming to a reasoned eotKhston. 

These stiafcnts arc careM, thoa|htAil readeis who pay attention to slgnlflranl details 
and shades of atcmiog. la resirartse to aniltiplo<lieioe qneslionik ihey can evaluate 
statements fcr asstm}^o(is and bias. In rtspcnse to opcrvcttdtd ifoesHons. they can 
Inletpiet written maBeilal in lenna of cnitnt, as well as Mslorfcal, issues and events. 



ERIC 



93 



94 



> 

I 




SUMMARY OF TESl ti£SULTS 
FOR WRITiNG 



tU: MOZtn 

DIatilct Wofc«»tBr 
Schook 

Dat«c April, 1994 



PROnaENCY 
LEVEL 


ALL STXJDEffTS 


Student Catogorioi 


Speclol N«ads 


Ttontltfonai Binngual 


Othar 








Scttod % 


8Ut» % School % 


State % 


School % 


Stale % School % 






1932 


mi 


199? 


332* 




1994 1992 1994 


1992 


1994 


11S2 1221 


sm 


333* ifsa 


1994 


WrltlTfl 


<l 


0« 


10% 




0% 


16% 


19% 


19% 


22% 




0% 


8% 


0% 




1 


27% 


34% 




40% 


42% 


51% 


93% 


40% 




26% 


33% 


40% 




n 


42% 


42% 




60% 


93% 


26% 


35% 


29% 




43% 


43% 


80% 




in 


18« 


13% 




0% 


6% 


4% 


11% 


8% 




19% 


14% 


0% 




tv 


4% 


2% 




0% 


1% 


0% . 


2% 


1% 




4% 


2% 


0% 



Below Lctd t: 

Hie opcn-«nded re$jx>n>e» of studcntJ In thli catrpn? provMc {nsufTtclcnt information 
to evaluate their prancknclct. Writing h not assessed using multiple-choice questions. 

Lerd I: 

Students M this prollcierKy level dtitio«ntr»te little sfcllity to communicilc with a 
reader. Their r e .t pon Ks are chariKteHml b> brevity, onctt limited to a !<ingSe run-on 
scrlcnoe. When these studcms give more complete anj*vrr». Ihek scttfetKCS oRen do not 
follow a loglca) progretuion. A rearrangement of sentences. For example, wtnitd not itler 
the meaning of the paragraph. In gcneril. their icsponscA lm%« little «ir nn <kvctopinent. 
using Hmileil detail. Their sentence sirtxtme mar be incotrcvt, with Inetrcclive «vord 
choice. Their lanKa.-ige is simplistic and their oontiol of satface Tcatures (mechanics, 
gr»Timar. spelling) is weak. 

Tbeae students do not I«»e a aensc of audience and experience dinicuUy in jvidging 
the icqaitcments oT the task, their responses tend *i> be concrete and personal rather 
than objeetiw. oOen Incorporating accounts of bow their lives and Immediate swroumllngj 
rclitc to the question. 



Urtl II: 

Students at this \t\x\ are able to communicate lt» a njdimentai>' Fashion. They attempt 
to oifMila their work in order lo comrmmicale with the leader and give IVltet, more 
cvmplctc irtfomes than stodenlj at Level I. SonK logical and stnKtural development 
b rrl^Rl in their attempH at paragraph stnicture: Tor example, they may include 
hNreductlont and cxmclaslom la the paragraph. 



These students are able to provide support Tor their arguments tning coniextutl 
evidence, but their responses lack coheston and completeness. SutOkc and synta.x ertott 
alto intcrfett with the ttadct's ability to tindcntand their urritlng. 

Level III! 

Students at this level cotr nunicate cfTecllvelyt providfaig more developed responses. 
They seem atvare of an blended audience, and theb' writing tends to be more fernia] 
and objective than experiential. The organliation of their responses Inchides a topic 
Kntencc and conclusion. They establish a priority In the piesentalion of their Ideas, with 
dtc main polnt(s) suppoiled 1^' appiopriale, relevant dctaOs. Their ivridng often benefits 
Com a mote comprehensive knowledge of the subject and ooneet use of vocabulary. 

Theae students have aome errors in surface features, but those enon are never great 
enough l9 htterfiire with oonNnunlcatioa 



Lr-tl IV: 

Students at Level IV comtnunlcite with clarity and eirtetivenets. Their writing conveys 
an avrareness of the reader and, when apprupdtte. a eleir voke. Their responses art 
well organised, both conceptually and in tcims of structoR. DiiTctctlt oomponenb ot their 
response ire clearly dcnwcated in pangwph form, wilh ait wttall coherence. Tl>ey 
develop their topics subtly and vdlh perception. Tbey use efftctive Itaigiiage and a welt- 
developed vocabuhry. as well as tnchuQag tich, Inteitstfeg details that enhance thclt 
discussion and support their putpo<& 
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MiMachvMtts 


mm 


AftMMllMlM 

ProQiMn 



SUMMARY OF TEST RESULTS 
FOR READING 



348275 



ID: 

Otstrteb 
School: 

DaUK AptlU 1994 




Bdow L«vci I: 

The open-«n<led itjpwBw of »<uden<j In Ihii etttgoty provide Injtifndcul Inronnatlon 
lo evatMle Ihelt predclencks. tlo««e*<Er. MudcnU In iMi caKtof^ are tHc Kj ansvrcr 
lotRC iinilt!p)c<«hoicc qvcaliom correct!/. 

Ufd 1: 

Students at tH» level are gWe to amwtcr nM)tiple-«liolce queillom pcruining to simply 
wItlHi. idathdy ihort nanatJves. Wentlfy the getting of a itoty and the majot rtoty 
everts Mhw one-step 4bectkms. am) locale hformation conuineii wllhbi the text 

T^Ir vocabvlaty Is Itmitcd to simple. conMnonly used «tords. b«t tfiey arc able to 
mc oontcKtMl chics to lecognlnt Mhcr notds, pravMed that ctioagh «t{stlt«aishlr« fealunt 

Theaa stvdenta cxpeiknca moie ditHeuhy vihm respendlng to open-ernkd qmtloni. 
Thty temi lo Identliy details ctMl repeit Inlbnnadofi Horn (he passage laltier tiuii lenetalt 
tWr awn responses. Aitkough *«• «Poo tfielr penonal essence and common 
•etut, Acy oOen ipply that kaowledge hutiprapriaiely to the qoestlon. 

Lt«d II: 

ShaferM at thh Icvd show an atnlliy to evaluate a set oT tmilttple-cholce options. 
Hiey can hfemtiy a cl«ractcr trail and ruid IKerat evidence to swpfxnt that trait. Tfccy 
are Mt to Wertiiy tome details thai ate related but haw dimeolty determiaing the most 
imponans iuca« 

f^tse sttidents are less stKcessrul when asked to ow a l m ct a respoase to an open* 
ended question. "Hicy are heglnrlnt to ase leaswning skills but oOen their reasoning is 
fitwtd or incomplete. Tlicy an able lo taka a positkm, allboogh they otrcr no explanations; 
or itey imy t^*" gencnllml explanaliora. rather than ase spcctlk tcxiaol evidence. 



Level III: 

Students at this prondcney level ate better able to deal vritti longtr lutrative passages 
of ntoie complex style and Mbjec< maner than those al the lower levels. Tbeit greater 
competence la teading allows them to ttmembcr details aiHf to provide Inreraitlal evidence 
that Is dependent upon a literal tntetpreiaKon oTlhe lesL 

They posscu a moio clabotatf lea^g vocabidaty than students at lower levels. Thtv 
ftcognltt the correct definitions of words, but dtcy d^crience dUlkaJly when wortii 
ate tscd In • tnott flguittive sense. 

"^^^J" opetKended qtiestionfl. iheM ttodetits an able to diaw eonetasions with 
relersnt tvppott flom tfie story. They can recognbe the main Idea of the passago and 
go beyond lllenK hteiptttMfam of the ItxL SpcttlieaOy, tliey can Inftr ehneter traits 
and peavMe stippotttiit rrtdenee. CmtTKlyt glvtfi an Inftienet. ttadtnu 
mppoti ftont the psssagt. Ahhoagh these' st^kots can answer the qacstions. their 
mpoRia are not elabotatc. 

Uvcl IVt 

Tbese atttdents appear to have achieved a Jevd of skill that alloM them to coniider 
passages as a (oUlhy. lalher than as a seqaencc of separate perls. They art able to 
tecognim the author behind the text, shoiving an endetstandlng of Ktetary devices and 
voice. They also andeistaad the author's Inteat and can IMc important Ideas nuale by 
the author. ' 

Students at (liis level are ptolkicnt in a broader range of readmg materials than those 
at the lower levels. They are particularly adept in answering multi-part qoesiltms. They 
are able to generate MI. well-ileveioped atgumenU and crptanalions. Tliey Justify iheir 
positioos with appropriate sappottlng evidence Ihim the pwaage. TTie students ase 
Information to hypothed/e and generalize. Ttielr InfVtcnoes are creatlw as »*tll as 
apixopHate and dear. Their resprnxi ate elahorak and coherent 
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Co-NECT Phase 2, Year 2 Second Quarter Report, January 1995 



TEACHER PKOFESSIONAI. DEVELOPMENT DATA 



Table 5 

Expeditionary Leainolng Teacher Survey: 
Respondents' Involvement in Selected Activities^ 





Participants 


Professional Development 


Nb 
(N="173) 


% 


School-based planning meeting 






Mini-sabbatical 


134 


77.5 


School— based team building 


105 


60.7 


One-day Expeditionary Learning 
orientation 


100 


57.8 


Summer Institute 






City Exploration Day° 


79 


45.7 


Pilot expedition with students 


63 


36.4 


Outward Bound/Wilderness 
Expedition 


40 


23.1 


Project Adventure Adventures in 
the Classroom 


38 


22.0 


Project Adventure Adventures-based 
Counseling 


16 


9.2 


Facing History/Facing Ourselves 


12 


6.9 


Education for Social 
Responsibility, Power of Numbers 


8 


4.6 



NOTISS: ^EL/OB Interim Report, February 1994. 

^The N represented is the highest number of 

respondents answering any item shown in this 
table. 



^Response may duplicate responses for One-Day 

Expeditionary Learning Orientation for Dubuque 
teachers. 
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Expttditlotiaxy Learning Teacher Survey: 
Respondents' Ratings of the Usefulness of 
Selected Staff Development Activities* 



Staff Development Activities 


Participant 
the Activity 


B Rating 
\f as Useful 


Kb 
(N-146) 


% 


Designing an expedition 
(curriculum development) 

Very useful 
Useful 


34 
91 


23 
62 


Carrying out an expedition with 
other teachers 

Very useful 
Useful 


38 
56 


26 
38 


Finding out about community 
resources 

Very useful 
Useful 


27 
68 


18 
47 


Learning about approaches to 
curriculiim development from groups 
such as Project Adventure or 
Educators for Social 
Responsibility 

Very useful 
Useful 


38 
53 


26 
36 


Hearing about other groups' ideas 

Very useful 
Useful 


23 
66 


16 
45 


Tecim building activities with 
teachers from my school 

Very useful 
Useful 


26 
58 


18 
40 


Getting to know and work with 
staff from other schools 

Very useful 
Useful 


20 
61 


14 
42 


Presenting ideas to a larger group 
(other than your school) and 
receiving feedback 

Very useful 
Useful 


17 
36 


12 
25 



NOTES: *EL/OB Interim Report, February 1994. 

^The N represented is the highest number of 

respondents answering any item shown in this 
table . 
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B. DESIGN-BASED SCHOOL REFORM 



The New American Schools Development Corporation supports nine 
Design Teams who have developed and are implementing comprehensive 
designs for high-performance schools. The nine designs represent 
differing philosophies and varied, research-based education practices. 
In their 1991 solicitation of reform models, NASDC specified that 
designs were to integrate all elements of a school's life. They were 
address whole schools-not just a single grade or program within a 
school. Designs were to be benchmarked against demanding goals and 
achievement standards. The designs were to be for all students, not 
merely those most likely to succeed. 

NASDC asked RAND to examine the development, initiation and 
implementation of the designs as work progressed through school year 
1994/95. RAND observed that Design Teams and schools made rapid 
progress. Analysts proposed that progress was hastened by the designs' 
broad visions of reform and. school change; by the fact that 
transformations involved entire schools, rather than smaller programs or 
design features; and through the provision of substantial technical 
assistance and professional development. 

RAND'S document reviews, discussions, interviews and focus groups 
provided information about progress and challenges for these designs. 
RAND'S analyses addressed eight program elements. These elements 
simultaneously describe the school as an organization and schooling as 
process; they provide a structure for examining school-wide change. 
RAND focused on elements largely common to the NASDC designs, including 
standards and assessment, curriculum and instruction, teacher 
professional development, technology use, school organization and 
governance, family and community services, public engagement, and 
school/system/designer partnering. These components are evident in othe 
design-based reforms, including those of the Coalition of Essential 
Schools, the Accelerated Schools Project, the Comer School Development 
Program, and Success for All. The program elements are: 
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School Refozm Elementa 



Standards and Assesament—Standards statements typically (1) outline the 
things students should know and be able to do and (2) lay out expected 
achievement levels. Assessments are the means by which student 
attainment is judged. 

Curriculum and Instruction—Curriculum outlines generally follow from 
standards statements and describe the knowledge and skills to be 
mastered; curriculum materials typically lay out the sequence in which 
learning occurs. Instruction is the means by which learning takes 
place. 

School Organization—The means by which (1) students are grouped in 
classes and (2) programs and staff are grouped and accorded 
responsibility for the student program. 

Teachar Professional Davelopoent— Professional development opportunities 
are the formal and informal faculty offerings designed to extend and 
support teachers' knowledge and practice. 

Technology Use— The ways that technology and information systems are 
used in instruction and in support of the program generally. 

School Governance— The means by which actors in the educational system 
(students, parents, teachers, administrators, school board members, 
district staff, state-level staff, etc.) are organized, make decisions 
about and manage the school. 

Family and Conaaunity Services— The social and health services provided 
through the program for students, families and communities. 

Public Engagement— The means by which stakeholders are invited to become 
knowledgeable about and participate in the program; these include 
volunteer and teaming opportunities for parents, community members, 
businesses and non-profits. 

School/System/Designer Partnering — The means by which school, 
jurisdiction, and design representatives initiate and maintain 
partnerships in developing and strengthening th e program. 
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C. OBJZCTIVKS STATEMENT WORKSHEET 



• Standards azid Assessinent 

Objective 1; 
Objective 2; 
Objective 3: 

• Curriculum and Instruction 
Objective 4 ; 
Objective 5; 
Objective 6; 

• School Organization 
Objective 7 : 
Objective 8 : 
Objective 9: 

• Teacher Professional Development 
Objective 10: 

Objective 11: 
Objective 12: 

• Technology Use 
Objective 13: 
Objective 14; 
Objective 15: 

• School Governance 
Objective 16: 
Objective 17: 
Objective 18: 

• Fainily and Comnunity Services 
Objective 19: 
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C. 2 

Objective 20: 
Objective 21: 

• 9\]bllc Engagement 

Objective 22: 

Objective 23: 
Objective 24: 

• School/System/Designer Partnering 

Objective 25: 
Objective 26: 
Objective 27: 

• Coinprehenslvd Student Performance and School Isprovement Goals 

Objective 28; 
Objective 29 
Objective 30 
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D. COMPBBHEKSIVE 0XrrCC»4ES WORKSHEET 



STUDENT PERFORMANCE DATA 







1994/95 


1995/96 


1996/97 


1997/98 


ATTENDANCE ^ RATES 


1 










PROMOTION RATES 












GRADUATION RATES 












DROP-OUT RATES 












DISCIPLINARY 
REFERRALS/ SUSPENSIONS/ 
EXPULSIONS 












PERFORMANCE ASSESSMENT DATA 
(describe assessment, 
nibrlcs, scale) 


Grade 












Grade 












Grade 











SCHOOL PERFORMANCE DATA 



TEACHER ATTENDANCE RATES 


' t'' ', 'f^'-'f ' ^ ' 'f. 










TEACHER RETENTION RATES 












PARENT/TEACHER CONFERENCE 
PARTICIPATION RATES 












PARENT VOLUNTEER RATES 












FAMILY/C(»4MUNITY SERVICE 
RATES 












COMMUNITY VOLUNTEER RATES 












BUSINESS /NONPROFIT 
PARTICIPATION 













10 J 
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Kxaxqpla Daflnltlons for CoEoprtthanslva Oufccoma Datia 
Studant P«r£oxtumce Data 

1. Attendance rates — percent of students present on an average school 
day from 9/30 through 6/1 (or during the official school year) . 

2. Promotion rates — percent of students advanced to a higher grade or 
instructional level at the conclusion of the school year. 

3. Graduation rates — number and percent of students con5>leting minimum 
requirements for a high school diploma. 

4. Drop-out rates (for middle and high schools) — number and percent of 
high school students withdrawing from high school (without transferring 
into another academic progreira) between 9/30 and 6/1 (or prior to 
cort^letion of the high school program) ; readmitted students dropping 
out on a second or subsequent occasion should be counted once. 

5. Disciplinary referrals/suspensions/expulsions — number and percent of 
students suspended, expelled or officially referred (beyond the 
classroom level) for disciplinary action. 

6. Performance assessment data (if available from an ongoing program) — 
summary information from performance-based assessments, including 
numbers and percents of students scoring at each standard or scale 
level, copies of the standard or scale descriptions/rubrics, and san5>le 
student work. 

School Performance Data 

7. Teacher attendance rates — number and percent of instructional staff 
present in school or in an approved teacher professional development 
session on an average school day during the official school year. 

8. Teacher retention (in the school) rates — number and percent of 
instructional staff retained in the school from each of (1) the 
beginning to end of the official school year and (2) one academic year 
to the next. 

9. Pa rent /teacher conference participation rates — percent of students 
for whom a parent or guardian attended official conferences. 

10. Parent volunteer rates — numbers of parents (and percents of 
families) volunteering and participating in the instructional program, 
in administrative support of the program, in fundraising actives, and in 
extracurricular activities. 

11. Family and community service utilization rates — by service category 
and overall, the numbers of (1) school fcimilies and (2) community 
members using social and health support services provided by the 
progreim. 

12. Community member volunteer rates — numbers of community members (not 
school families) volunteering in the instructional program, in 
administrative support of the progreim, in fundraising activities, and in 
extracurricular activities. 



ERIC 



10/ 



D. 3 



13. Numbers of businesses/nonprofits participating in the program — 
niunbers of businesses partnering with or participating in the school in 
support of the instructional program and in administrative and financial 
support . 
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E. PROGRESS INDICATOR/BENCHMARK WORKSHEET 





Obiective 26: 










Obiective 27: 










• Comprehenslvo Student 
Pftrformanctt and School 
Ixq»rovement Goals 






















Objective 28 












Objective 2 9 












Obiective 30 













1 1 i 

1 . 
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V. DATA COLLECTION HORXSHEET 



GOALS 


IMDZCA70RS 


DATA COLLECTION 
METHOD 


DATA S0X7RCS 


DATA COLLECTION 
WINDOW 


• Standards and Assessment 


^^^^^^^^^^^^^^^^^^^^^^^ 










Obiective 1; 












Obiective 2- 












Obiective 3 












• Curriculum and Instruction 














Obiective 4 












Obiective 5 












Obiective 6 












• School Orqanlzatlon 


\ * 








^^^^ 


Obiective 7 












Obiective 8 












Obiective 9 












• Teacher Professional 
Development 










Obiective 10 












Obiective 11 












Obiective 12 













• Technoloqy Use 










Objective 13: 










Oblective 14: 










Obiective 15: 










• School Governance 










Obiective 16: 












Objective 17- 












Objective 18- 












• Family and Community 
Services 




I 


^^^^^^^^^^^^^ 

^^^^^^^ 




Objective 19 












Objective 20 












Objective 21 












• Ptiblic BnQaqement 












^ i 


Objective 22 












Objective 23 












Objective 24 












• School/System/Designer 
Partnering 










Objective 25: 











1 J < 



Obiective 26: 










Obiective 27 : 










• CoEDpxehensive Student 
Parfozmanctt and School 
Zmprovenent Goals 




^^^^^^^^^^^^^^^^^^^ 






Obiective 28 












Obiective 29 












Obiective 30 













1 f.^ 



ERIC 



G. 1 



G. 



IMPLEMENTATION OBSEPVABI£S CBECKXIST 



Standards and Assessment 

□ Standards statements 

□ Schedule of training and materials given to teachers to help 
them understand new standards 

□ List of names of members of local standards committees ad 
exair5>le minutes of meetings copies of materials given to 
students, parents, and/or community members explaining new 
standards 

□ Available documentation on the links between standards and 

curriculum, and standards and assessments 

□ Schedule of training and materials given to teachers to do 

portfolio assessments and other new assessments 

□ Sairples of portfolios assessments 

□ Samples of alternative assessment tasks not part of portfolios 

□ Statements of examples of scoring criteria for portfolios and 

non-portfolio assessments 

□ Documentation of changes in student achievement 

□ Documentation on the links between curriculum and assessments 

Curriculxim and Instzruction 

□ Exan?>les of lesson plans, units of study, etc. 

□ Number of lesson plans or units of study developed versus 
number remaining to be completed to cover full curriculum by 
grade level 

□ Sequence across grades of new curriculum (schedule for a 
student) 

□ Other changes to courses, course content, -and course sequencing 

□ Docu:nentation of connections to community in curriculum areas 

□ Description of quality control mechanisms in place for newly 
developed curriculum. For example, teacher peer review, review 
by design team, etc. And, evidence of subsequent changes or 
dropped units (for exairple, five units dropped after peer 
review) 
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□ Schedule of training and inaterials for teachers for new 
curriculxim 

□ Schedule for con^iletion of all required curriculum units 

□ Schedule for adoption of instructional strategies 

□ Schedule and materials provided teachers for new instructional 
strategies 

□ List of places teachers use for community as classroom 

□ List of when the community has come into the classroom - 
speakers, performers 

□ Exait¥>le of schedule that allows for students' individual 
choices 



School Organisation 

□ Teachers' school day schedule demonstrating time for teaming, 
curriculum writing, paperwork, etc. 

□ Documentation of new/changed staffing patterns including master 
teachers, apprentices, aides, volunteers, facilitators 

□ List of new grade combinations, teacher team combinations, 
etc . , and when they went into effect 

□ Relative number of classes covered by these new combinations 
versus classes that have not converted 

□ Description of student placement procedures 



Teacher Professional Development 

□ Schedule of teacher professional development meetings 

□ Workshop materials 

□ Workshop attendees roster 

□ School visit agendas 

□ Documentation of ongoing teacher collaboration 
Technology Use 

□ List and location of newly purchased, design related equipment 
(classroom, labs, principal's office) 

□ Schedule for purchasing more design related equipment 

□ Schedule and materials for training 

□ List of software programs /packages used 
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□ Examples of curriculxim units incorporating technology 

School Govttmance 

□ List of names of meunbers of various committees required by 
design 

□ Schedule and materials for training in new governance roles 

□ Schedule of committee meetings and examples of minutes from 
meetings 

□ Significant products of the committees, such as new schedules 
for courses, standards for exert^lary student products, new 
standards, plans for technology, school irt^rovement plans 

□ Newly developed rules, regulations, master contracts, site- 
based management plans, waivers, and district-school agreements 
about school level control over budget, hiring, firing, 
evaluation, or mission 

□ List of incentives to encourage new behaviors 

□ Master contract changes to accommodate these roles 

□ Grievances filed concerning new roles 

□ Hiring/layoffs due to design irt^lementation 

□ Description of new roles for administrators 

Family and Community Services 

□ Name of social services coordinator for school 

□ Schedule for different activities 

□ Indicators of utilization of or participation in these services 

Public Engagement 

□ Schedule of public meetings 

□ Materials explaining reform program for parent and community 
audiences 

□ Materials explaining reform for education stakeholder audiences 

□ Sair5)les of newspaper articles and newsletters for lay 
con3uir5>tion 

□ Community volunteer roster 

□ Business/nonprofit participation agreements 
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School/Syatam/DAsign Partzuarlng 

□ Statements of partnership objectives 

□ Schedules for and minutes from partner meetings 

□ Products jointly developed by partners 
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H. CZASSROOM OBSERVATION 6CIOE 



CLASSROOM PRACTICES: A GUIDE FOR ATLAS OBSERVATIONS ^ 

1 . Are students spending a good deal of time talking with one another 
and the teacher: sharing, questioning, discussing, debating? 

2. Are students regularly involved in efforts to demonstrate their 
understandings within and beyond their classroom: e.g. communicating 
knowledge to others; advocating solutions to problems; providing 
assistance to others; creating performances or products with utilitarian 
or aesthetic value? 

3 . Do students have regular opportunities to work cooperatively? To 
reflect on their work and share it with others? Do students solicit and 
welcome contributions from others? 

4 . Are the materials that are employed thought -provoking? Do they 
stimulate real-life work and sharing among the students? 

5. Do teachers and students regularly work on problems or issues that 
they see as connected to their personal experiences or conteitporary 
concerns? 

6. Do the products students are being asked to produce require them to 
think critically or creatively; to conduct research; to examine 
perspectives; to analyze, evaluate, and to come to conclusions; to 
communicate thoughtfully; to create or design original works; to conduct 
real-life tasks? 

7. Does the teacher appear to know each student well? Does s/he know 
students' strengths and needs? Does s/he appear to tailor her/his 
interactions and requests accordingly? 



^ATLAS, 1994. 
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8. Is the classroom atmosphere welcoming, warm, and energized? Are 
students working: Are they respectful of one another? Are students' 
works posted? Are only exceptional works posted? 

9. Does the teacher move about the room and make close contact with 
each student? Does s/he actively seek to engage each student in some 
fashion? 

10. Does the teacher clearly communicate his/her expectations and are 
they challenging (as represented through the work that's recpiired of 
students) ? 

11. Does the teacher regularly collect a variety of data, through 
portfolios, classroom exhibitions, tests, quizzes, homework, and other 
products to monitor students' performance and progress? 

12. Does the teacher check students' performance on products, hold 
students accountable for quality work, clearly communicate results to 
students, celebrate success, and motivate students to E>ersist in the 
face of occasional setbacks? 

13. How much time does a teacher spend: 

• presenting factual information, 

• discussing factual information with students, 

• posing challenging questions about information (and encouraging 
students to do the same) , and allowing students to make meaning 
of the information through the pursuit and discussion of these 
questions? 

14 . Does the teacher devote significant time to teaching and assessing 
reading, writing, speaking, research, and other content-specific basic 
skills? 

15. Does the teacher allow students to take optimal and appropriate 
responsibility for their own learning, given their particular 
developmental level? 

16. When engaged in questioning activitieo, does the teacher allow 
students sufficient time to think about and answer the questions? Are 
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Students expected to answer the questions in complete sentences and with 
depth? Does the teacher probe for greater detail, clarity, or 
thoughtfulness when answers are brief, sketchy, or superficial? Does 
the sequence of questions (to one more students) build coherently on 
participants' ideas? 



REFORM SURVEY INSTRtJMENTS 




Modern Red Schoolhouse 
Teacher Survey 
1995 

Instructions 

77/w is a survey for teachers participating in the Modern Red Schoolhouse 
initiative. It is intended to help us gauge the degree to which you think you 
understand various elements of the design and the degree to which you think the 
design has affected student behavior and learning. We realize that, for instance, 
with changes in student learning, it is hard to know exactly which program 
elements are having the biggest effect on students. Your best judgment is all that 
we can ask. 

Keep in mind that your honest assessment will be the most helpful to our work. 
Knowing the strengths and weaknesses of any effort can only make it better. 
Your comments will be kept strictly confidential. All reporting within Hudson 
will be done only at a school level. Results distributed to the public will not 
identify the name of any school with any responses from this survey. 

Please read through the instructions below and then proceed to answer the 
questions in a way that best describes your response to each question. 

1. Write your name on the cover sheet and detach it. Your site coordinator 
will collect it prior to the time you begin the survey. 

2. Please complete the survey during one sitting if possible. We estimate 
that it will take approximately a half hour. 

3. All of the questions require one response only. Please select only one 
of the many response choices given. 

4. When you have completed the survey, please return it to your site 
coordinator by no later than Thursday, March 9th. 



We indeed thank you for your assistance and cooperation! 



TEACHER SURVEY 



Please indicate your responses by marking your answers directly on this questionnaire. 
Project Effectiveness 

Please provide your best estimate of how the Modern Red Schoolhouse design has improved 
your school in the following areas: (Circle either "3, 2 or J "). 



1 . Teachers use of 

technology in their classrooms 

2. Teachers' roles in making 

school decisions 

3. School autonomy 

4. Leadership skills 

5 . Parent involvement 

6. Community involvement 

7. Students' engagement with 

learning 

8. Achievement levels of 

all students 



A lot 



3 
3 
3 
3 



Some 



2 
2 
2 
2 



None 
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Teacher Survey 



Please indicate how well you understand each of the following Modem Red Schoolhouse concepts, 
very well, well, somewhat, or not well. (Circle the number that best describes your judgment of how 
well you understand each concept.) 




9. 


MRSH standards 


5 


4 


3 


2 


1 


in 
















curriculum. 


5 


4 


3 


2 


1 


11. 


Work force skills 


5 


4 


3 


2 


1 


12. 


Character development 














throiiph estahlishinp ccstp 

kill v/ugi 1 ^omciioiiiiig ^v/lLf 














virtues with community. 


5 


4 


3 


2 


1 


13. 


School autonomy 


5 


4 


3 


2 


1 


14. 


Developing a staffing 














structure that matches needs 














of students 


5 


4 


3 


2 


1 


15. 


Continuous progress to all 














students 


5 


4 


3 


2 


1 


16. 


The Individual Education 














Compact (lEC) 


5 


4 


3 


2 


1 


17. 


Technology and information 














networks 


5 


4 


3 


2 


1 


18. 


Primary, Intermediate, and 














Upper divisions 


5 


4 


3 


2 


1 


19. 


Parental choice 


5 


4 


3 


2 


1 


20. 


Hudson Units 


5 


4 


3 


2 


1 


21. 


Watershed assessments 


5 


4 


3 


2 


1 


22. 


Student Reports 


5 


4 


3 


2 


1 


23. 


School Reports 


5 


4 


3 


2 


1 


24. 


Pre-school consortium 


5 


4 


3 


2 


1 


25. 


Parent involvement 


5 


4 


3 


2 


1 


26. 


Parental Information Centers 


5 


4 


3 


2 


1 


27. 


Community support 














.services for students 


5 


4 


3 


2 


1 



Teacher Survey 

Please indicate the extent to which each of the following Modem Red Schoolhouse concept s is observ- 
able at your school. ( Circle the number that best describes the level at which each listed concept is in 
place at your school.) 

5 = implemented fully 



4 = implemented to a large degree 
3 = implemented to a moderate degree 
2 = minimally implemented 
1 = has not been implemented 




28. MRSH standards 5 4 3 2 

29. Core Knowledge 

curriculum 5 4 3 2 

30. Work force skills 5 4 3 2 



31. 


Character development 


5 


4 




0 


32. 


School autonomy 


5 


4 


3 


2 


33. 


A staffing structure that 












matches needs of students 


5 


4 


3 


2 


34. 


Continuous progress to all 












students 


5 


4 


3 


2 


35. 


The Individual 












Education Compact (EC). 


5 


4 


3 


2 


36. 


Performance grouping 


5 


4 


3 


2 


37. 


Multi-age homerooms 


5 


4 


3 


2 


38. 


Technology and information 












networks 


5 


4 


3 


2 


39. 


Primary, Intermediate, and 












Upper divisions 


5 


4 


3 


2 


40. 


Parental choice to attend 












this school 


5 


4 


3 


2 


41. 


Hudson Units 


5 


4 


3 


2 


42. 


Watershed assessments 


5 


4 


3 


2 


43. 


Student Reports 


5 


4 


3 


2 


44. 


School Reports 


5 


4 


3 


2 


45. 


Pre-school consortium 


5 


4 


3 


2 


46. 


Parent involvement 


5 


4 


3 


2 


47. 


Parental Information 












Centers 


5 


4 


3 


2 


48. 


Community support 












services for students 


5 


4 


3 


2 
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Teacher Survey 

Please provide your best estimate of the degree to which the academic achievement of your students has been 
improved by these Modern Red Schoolhouse elements. 



5 = Very Positive effects. 

4 = Some Positive effects. 

3 = No effects. 

2 = Some Negative effects. 

1 - Very Negative effects. 

0 = Not implemented at this time 



^0 ^e<^ 



V 



ft 



49. 


MRSH standards 


5 


4 


3 


2 


1 0 


50. 


Core Knowledge 














curriculum 


5 


4 


3 


2 


1 0 


J! I . 


\A/i^t*l^ TV\T'/^0 cl^lllO 

worK lorce skuis 


c 
3 


4 


5 


I 


1 A 
1 U 


52. 


Character development 


5 


4 


3 


2 


1 0 


53. 


School autonomy 


5 


4 


3 


2 


1 0 


54. 


A staffing structure that 














matches needs of students 


5 


4 


3 


2 


1 0 


55. 


Continuous progress to all 














students 


5 


4 


3 


2 


1 0 


56. 


The Individual 














Education Compact (lEC). 


5 


4 


3 


2 


1 0 


/ . 


r enonuance grouping 


c 

J 


4 


3 


2 


1 e\ 

1 0 


58. 


Multi-age homerooms 


5 


4 


3 


2 


1 0 


59. 


Technology and information 
















c 

J 


A 

4 


D 


I 


1 0 


60. 


Primary, Intermediate, and 














Upper divisions 


5 


4 


3 


2 


1 0 


61. 


Parental choice to attend 














this school 


5 


4 


3 


2 


1 0 


62. 


Hudson Units 


5 


4 


3 


2 


1 0 


63. 


Watershed assessments 


5 


4 


3 


2 


1 0 


64. 


Student Reports 


5 


4 


3 


2 


1 0 


65. 


School Reports 


5 


4 


3 


2 


1 0 


66. 


Pre-school consortium 


5 


4 


3 


2 


1 0 


67. 


Parent involvement 


5 


4 


3 


2 


1 0 


68. 


Parental Information 














Centers 


5 


4 


3 


2 


1 0 


69. 


Community support 














services for students 


5 


4 


3 


2 


1 0 
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Teacher Survey 

How often do some Students demonstrate the following behaviors in your classroom: everyday, several 
times a week, several times a month, or never ? 



70. Students bring items from home 
which support school studies 

7 1 . Students finish work and 
have nothing to do 

72. Students work in small 
groups to solve complex 
problems 

73. Students talk about what 
they learn in class outside 
of the classroom 

74. Students are frustrated and 
confused over assignments 

75. Students complete work and 
don't know what to do next 



O 1 J i 
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Teacher Survey 

About how often do some students in your classroom do the following: everyday, once or twice a week 
once a month, hardly ever or never ? 



0^ 
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76. help other students having 
difficulity with an assignment 

77. work in performance level groups 

78. skip class 

79. misbehave and disrupt others 
from learning 

80. work one-on-one 
with you 

81. work with another 

student having a different skill- 
level in a particular subject 

82. work alone 

83. read books that are 
not assigned 

84. obtain assistance from an 
adult volunteer or other staff 
member 

85. decide how to present 
what it is they have learned. 

86. use computers to 
support academic activities. 

87. use the school library 

to find resources for projects. 



4 

4 
4 



3 
3 



2 
2 
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Teacher Survey 

School Climate 

Following area number of statements that might be made about your school Please indicate your level 
of agreement with the statement by circling a number between 5 (Strongly agree) and 1 (Strongly 
disagree) on the scale located to the right. 



Strongly 
Agree 



Strongly 
Disagree 



88. The school has a written mission 
statement that is shared by all 
stakeholders. 

89. This school's mission statement 
makes direct reference to teaching 
and learning for all. 

90. What must be learned, and who is 
accountable, is clear at this school. 

9 1 . The climate of the school reflects the 
belief that all students can succeed. 

92. School goals and objectives are clearly 
stated in a way that provides direction 

93. School goals and objectives are 
achievable. 

94. School goals and objectives are 
translated into action plans by staff. 

95. At this school we are trying to 
build a community of shared 
values and beliefs. 

96. This school fosters a sense of owner- 
ship and leadership among staff by 
involving them in decisions about the 
school and school programs. 

97. I am satisfied with the level and 
nature of my involvement in decision- 
making. 

98. In this school I am encouraged to 
experiment with my teaching. 



5 4 3 2 



5 4 3 2 



5 4 3 2 
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Teacher Survey 

Following are a number of statements that might be made about your school. Please indicate your level of 
agreement with the statement by circling a number between 5 (Strongly agree) and 1 (Strongly disagree) on the 
scale located to the right. 

Strongly Strongly 
Agree Disagree 

99. Teachers at this school have high 
expectations for their own 

performance. 5 4 3 2 1 

1 00. At this school there are a broad 
array of teaching strategies being 

implemented. 5 4 3 2 1 

101. Staff morale is high — administrators, 
teachers, and other school staff 

exhibit pride in the school. 5 4 3 2 1 

102. Student morale is high — students 

exhibit pride in the school. 5 4 3 2 1 

1 03 . We have the tools to appropriately 
monitor student progress at this 

school. 5 4 3 2 1 

1 04. Student progress is best measured 
through the use of norm-referenced 

tests. 5 4 3 2 1 

1 05 . Results of measurements of student 
progress are appropriately used to 
improve individual student 

performance and guide instruction. 5 4 3 2 1 



I 
I 
I 
I 

1 06. This school has good alignment 
V between the written, taught and 

* tested curriculum. 

H 107. This school is making good use of 

technology by both teachers and 
students to monitor learning 
progress. 



I 
I 
I 



1 08. This school is making an appropriate 
move toward more authentic forms of 
assessment. 



Teacher Survey 



Following are a number of statements that might be made about your school. Please indicate your level 
of agreement with the statement by circling a number between 5 (Strongly agree) and J (Strongly disagree) 
on the scale located to the right. 



Strongly 
Agree 



Strongly 
Disagree 



1 09. The atmosphere of this school 
is professional. 

110. The environment of this school is 
conducive to learning. 

111. Students at this school work well 
together. 

112. Teachers at this school express a good 
deal of collegiality among their peers. 

113. Leadership abilities are nurtured at this 
school for both teachers and students. 

1 14. School and classroom environments are 
safe for people and property. 

115. Staff accept and take responsibility for 
school rules and standards. 

1 1 6. Students accept and take responsibility 
for school rules and standards. 

117. I have a sense of satisfaction in my 
professional role and feel I have a 
positive impact on students. 

118. Staff members are recognized for a 
job well done. 

1 1 9. Parents understand and support 
the mission of this school. 

1 20. Parents volunteer as much as they 
need to at this school. 



4 
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Teacher Survey 

Following are a number of statements that might be made about your school. Please indicate your level 
of agreement with the statement by circling a number between 5 (Strongly agree) and 1 (Strongly disagree) 
on the scale located to the right. 



Strongly 
Agree 



Strongly 
Disagree 



121. This school is working adequately 

on building authentic partnerships with 
parents on issues pertaining to school 
governance. 

122. This school is adequately working 
on building authentic partnerships 
with parents on issues pertaining to 
student learning. 

1 23. This school offers parents training 
in how to support their children's 
learning. 



5 4 



2 1 



5 4 



5 4 



2 1 



2 1 



In comparing student behavior in your classroom this academic year with the previous year, 
what is your best estimate of the following: 



1 24. Student attendance is: 



□ better 



□ worse 



□ the same 



1 25. Student interest in learning is: 

□ better □ worse □ the same 

126. Student misbehavior is: 



□ better 



□ worse 



□ the same 



10 



Teacher Survey 



127. In general, how would you now characterize your support of the Modem Red Schoolhouse 
program in your school? Please circle one response. 

Strong Moderate Slight Slight Moderate Strong 

Support Support Support Opposition Opposition Opposition 

6 5 4 3 2 1 



Below are questions that are intended to gather information about teachers as a group. Please com- 
plete the following information about you. ( Circle the letter that applies). 

128. Sex: ( A ) Male ( B ) Female 

129. Ethnicity (A)Caucasian (B)Latino ( C ) Native American 

( D ) Black ( E ) Asian ( F ) Other 

130. How many years including this one have you participated in the Modern Red Schoolhouse 
project? 

A. Since our school considered joining, 1992. 

B. Fall, 1993. 

C. Fall, 1994. 

D. Other, please specify: 

131. Please indicate whether or not you participate in any state or district performance pay 
or incentive wage program. 

A. I do participate in a performance pay or incentive wage program. 

The name of the program is: 

B. I do not participate in a performance pay or incentive wage program. 

132. How many years of full-time teaching experience do you have? 

A. More than 20 years. 

B. 15 -19 years. 

C. 10- 14 years. 

D. 5-9 years. 

E. 1-4 years. 

1 33. How many years have you taught bilingual/LEP/bicultural students (including 
this year)? years or, 

□ I have never taught bilingual/LEP/bicullural students. 
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Teacher Survey 

Academic/Professional Background 

134. What is the highest degree you have received? 

( A ) Bachelor's + teaching credential ( D ) Master's + units beyond 
( B ) Bachelor's + some units beyond ( E ) Doctorate 

credential ( F ) Other 
( C ) Master's (specify) 



135. Please indicate your certification and the subjects, grade levels, and specialties for 
vchich you are qualified: (Check all that apply) 

A. State Department of Education. Please name the states: 



B. National Board for Professional Teaching Standards. Please name 
the subjects: 



C. Other, please specify): 



D. I am not certified by any legal entity as of the date of this survey. 

136. Please indicate which teaching credentials you have and specify the content area of 
specialization. ( Circle all that apply.) 

( A ) General Elementary ( E ) Single Subjects 

( B ) General Secondary ( F ) Bilingual 

( C ) Special Emergency ( G ) Early Childhood 

( D ) Multiple Subject ( H ) Special Education 

( I ) Other: . 



If you have any other comments about the positive or negative effects of the Modem Red Schoolhouse 
program in your school, please provide them in space provided below. 



THANK YOU FOR YOUR COOPERATION IN COMPLETING THIS SURVEY. 
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Los Angeles 
Learning Center 
Administrator Survey 
1994 



Name. 



First 



Last 



Please Print Clearly 
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Adminstrator Questionaire 
1994 

Dear Administrator: 

Your response to this siirvey will shed light on the many changes 
that are taking place at your school as part of the Los Angeles Learning 
Center (LALC), funded by the New American Schools 
Development Corporation (NASDC). The survey is part of a two-year 
evaluation of the overall LALC program for NASDC. It is being conducted 
by the Center for the Study of Evaluation at UCLA. 

The purpose of the evaluation is to discover how the LALC design is 
implemented at your school and what are the effects on teachers, students 
and the school as a whole. 

In the future, it will be very interesting to look back and see what 
changes and progress have occurred. When these data are combined with 
data from other NASDC schools across the country, the results will help us 
all understand the value of what you are being asked to do. In the interim, 
the LALC Management Team may provide your site-based management 
council with feedback from the program evaluation that might be of value to 
your school. 

We need you to be candid with us. The information is confidential and 
no one's name will be used. Your participation is voluntaiy, and you may 
decUne to answer any question. Feel free to add additional comments to 
ehelp us understand and shape this project. 

Many thanks for your cooperation! 

If you have any questions, please call Pam Aschbacher at CSE 
(310/206-1532). 



3 
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Los Angeles Learning Cewter Administrator Survey-94 



ID# 

CSE will complete 

Los Angeles Learning Center 
Principal and Assistant Principal Survey 

1994 

1. How many years have you been a school administrator prior to this year? 
(public or private schools) 



2. How many years have you been an administrator at this school prior to this 
year? 



3. Sex: □ Female □ Male 

4. Do you consider yourself bilingual? (in Spanish and English) 

□ Yes with bilingual credential 

□ Yes, without credential 

□ No 



5. List any professional networks or organizations to which you currently belong 
(such as Association for Supervision and Curriculum Development, etc.): 
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Los Angeles Learning CEhfTEft Administrator Survey-94 



6. How clear and well described are these LALC 
implemented at Elizabeth Street School? 
(circle a number for each concept listed) 



a. "Moving Diamond" system of child advocacy 

b. Multi-age clustering of students 

c. Collaborative planning by teacher teams 

d. Thematic, interdisciplinary curriculum 

e. Instruction based on current theories 
of learning and multiple intelligences 

f Commimity as integrated resource 

g. School-based health and social services 

h. Technology as integrated classroom resources 

i. Teachers as continual learners 

j. Teachers sharing in school decision-making 
and governance 

7. How is your job different under the LALC program' 



1 2 3-45 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 



5=very clear and well described 
4=clear and well described 
3=soniewhat described 



2sunclear and not well described 
l=very unclear and not well described 
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8. In general, how would you characterize your attitude toward the LALC 
program at your school? (Circle one.) 

strong moderate slight slight moderate strong 
opposition opposition opposition support support support 

1 2 3 4 5 6 



9. What aspects of the LALC program do you feel most enthusiastic about? 



10. What aspects do you feel most uncomfortable or uncertain about? 



11. What influence, if any, has the LALC Program had to date on these aspects 
of your job? 

7 =5 big increase 3 = small decrease 

6 s moderate increase 2 » moderate decrease 

5 - small increase 1 s big decrease 

4 =5 no change 0 = don't know 



a. Exchange of ideas with colleagues and 

staflfat the school 0 1234567 



b. Exchange of ideas with colleagues 
outside the school 



0 1 2 3 4 5 6 7 



c. Opportunity to tise my special 
strengths, interests and expertise 



0 1 2 3 4 5 6 7 



d. Enthusiasm for duties as an 
administrator 



0 1 2 3 4 5 6 7 
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Los Angeles LEflRmNG Cemter Administratot SuhveV-94; 



11. (con't) 

e. Pride in my profession 



f. Interest in working with parents 



g. Role in school decision-making 



h. Using technology in my work 



i. Interest in becoming (more) fluent 
in a second langiiage 



j. Understanding how people learn 
and change 



01234567 



01234567 



01234567 



0 12 3 45 6 7 



01234567 



01234567 



k. Understanding what motivates . people to 

learn and change 01234567 



1. Involvement in students' health, safety, 

and psychological well-being 01234567 



m. Effort it takes to do my job 



n. Time spent outside school hours 
that relate to duties as an 
administrator 



0. Access to interesting people and 
opportxinities 



p. Other: . 



01234567 



01234567 



01234567 



01234567 
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Los Angei£s Lemning Center Aoministratoh SufivEY-94 



12. Indicate the extent to which you agree/disagree with the following: 

strongly strongly 
<iisagree agree 

a. Teachers are involved in making 

decisions that affect them 1 2 3 4 5 6 

b. The school administration's behavior 
toward teachers and others is 

supportive and encouraging 1 2 3 4 5 6 

c. I feel comfortable voicing my 

concerns in this school 1 2 3 4 5 6 

d. I have influence on the decisions 

that directly affect me 1 2 3 4 5 6 

e. The Lead Teacher position is helpful 1 2 3 4 5 6 

f I am certain I am making a difference 

in the lives of the students 1 2 3 4 5 6 

g. Compared with other administrators 
in this district, my professional 

workload is fair and reasonable 1 2 3 4 5 6 

h. This school makes an effort to reach 

out to the community 1 2 3 4 5 6 

i. My work in this school is evaluated fairly 1 2 3 4 5 6 

j. Most of the staff share my beliefs and 
values about the central mission 

of the school 1 2 3 4 5 6 

k. Goals and priorities for the school are clear 1 2 3 4 5 6 

1. I feel accepted and respected as a 

colleague by most staff members 1 2 3 4 5 6 
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Los Angeles Learning Qemter Administrator Survey-9.4 



12. (Con't) 



m. There is a great deal of cooperative 
effort among staff members 

n. Students here want to be 
high achievers 

0. Students here look out 
for each other 

p. The LALC program at this school will 
be good for our students 

q. Administrators in this school are 
continually learning and seeking 
new ideas. 

r. We pay attention to students' feelings 

s. The parents really appreciate what we 
are trying to do at this school 

t. Parents support their children's learning 

u. There is good communication 
at the school 

V. The LALC program is asking us to 
make too many changes at once 

w. Students here are capable of 
high achievement 

X. The LALC program is worth all the 
time and effort 



3 4 



3 4 



5 6 



3 4 5 6 



5 6 



2 3 4 5 6 

2 3 4 5 6 

2 3 4 5 6 

2 3 4 5 6 

2 3 4 5 6 

2 3 4 5 6 

2 3 4 5 6 

2 3 4 5 6 

2 3 4 5 6 
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Los Angeles Learning Center Administratpr Survey-94 



13a. What kind of effects, if any, has the LALC program had on students so far? 



13b. How do you know? 



14a. What effects has the program had on teachers so far? 



14b. How do you know? 



15a. What effects has the program had on others so far? 
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Los Angeles Learning Center Administrator Survey-94 



15b. How do you know? 



16. What are the biggest barriers you face implementing the LALC program? 



17. What kinds of support or resources are or would be most helpful to you? 



] , . What should we do differently at the second NASDC site? 



19. Please tell us anything more you'd like us to know about the LALC program 
at your school. 



Many, Many Thanks For Completing This Survey!! 
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School 



Grade Levels Served. 



Full Time / Part Time. 
Date 



Code Number. 



Roots and Wings School Staff Survey 

Please indicate your agreement or disagreement with the following statements about the 
Roots and Wings (R&W) components. Rate the actual value of each component to 
your school. If you are unfamiliar with the component indicated in an item, leave that 
item blank. 

ACTUAL VALUE 





Not 

Some- Familiar 
Very what Not With 
Valuable Valuable Valuable Valuable Component 
4 3 2 1 NF 


1 . The Instructional Philosophy 
of Roots and Wings 


4 


3 


2 




NF 


2. The Birth-to-Age-Three 
Components of the Program 


4 


3 


2 




NF 


3. The Kindergarten Program 
(STaR/Thematic Units) 


4 


3 


2 




NF 


4. The Reading Roots Program 
(Grade One) 


4 


3 


2 




NF 


5. The Reading Wings Program 
(Grades Two-Five) 


4 


3 


2 




NF 


6. The Math Wings Program^ 


4 


3 


2 




NF 


7. The WorldLab Program 


4 


3 


2 




NF 



More 



1 ^ . 
ERIC 
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ACTUAL VALUE 



Some- 
Very what Not 
Valuable Valuable Valuable Valuable 



8. The Cooperative Learning 
Strategies 

9. The Family 
Support/Enhanced Pupil 

Services Team 



4 
4 



10. Tutoring 



1 1 . The Technology Included in 
the Program 

12. The Special Education 
Practices of the Program 



4 
4 



13. The Staff Development 
Received to Support the 
Program 

14. The Instructional Facilitator 



15. The Family Support 
Coordinator 



16. The Parent Involvement 
Programs 



17. The After SchooVExtended 
Day Program 

18. The Family Health Center 

19. The Level of Support for the 
Program by the Principal 



4 
4 



20. The Level of Support for the 
Program by the Teachers 



3 
3 



3 
3 



3 
3 



2 
2 



2 




NF 


2 




NF 


2 




NF 



2 
2 



Not 
Familiar 
With 
Component 
NF 



NF 



NF 



NF 



NF 



NF 



NF 



NF 
NF 

NF 
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21. The Level of Support for the 
Program by County 
Supervisors 


4 


3 


2 


1 


NF 


22. The Level of Support for the 
Program by Johns Hopkins 
Developers and Trainers 


4 


3 


2 


1 


NF 


Please indicate your agreement or disagreement with the following statements. 

RATE THE FOLLOWING 




Strongly ^^^2. 
Agree Agree Decided 


Disagree 


airongiy i 
Disagree 1 


23. R&W has had a positive 
impact on student 
achievement. 


SA 


A 


U 


D 


SD 

SD 1 


24. R&W has had a positive 
impact on student 
motivation and attitudes 
towards learning. 


SA 


A 

A 


T T 
U 


D 




25. R&W has had a positive 
impact on the learning of at 
risk students. 


sa" 


A 


u 


D 


SD 


26. R&W has had a positive 
impact on the learning of 
gifted students. 


C A 


A 


TT 


D 


SD 


27. R&W has had a positive 
impact on the staff attitudes 
toward teaching. 


SA 


A 


u 


D 


SD 


28. R&W has had a positive 
impact on teachers' 
instnictional strategies and 
professional growth. 


SA~ 


A 


u 


D 


SD 


29. R&W has been a positive 
collaboration between the 
District, the Stats Education 
Department, and Johns 
Hopkins University. 


SA 


A 


u 


D 


SD 


30. I want R&W to continue at 
my school in the future. 


SA 


A 


u 


D 


SD 
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I 

I 

Do you have any suggestions for improving the Roots and Wings program? If so, ■ 
please describe below. j 
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EXPEDITIONARY LEARNING OUTWARD BOUND 
SIXTH GRADE QUESTIONNAIRE 
1995 



The following questions ask you to check or write in an answer. Please read the directions for each 
question carefully. Choose the answer that is most true for you. 

1. First, tell us something about yourself and your family. 

1 . What grade are you in? 



2. What is your date of birth? (write in) 

month day year 

3. What is your gender? (mark one) 

Male O 

Female O 

4. Which best describes you? (mark one) 

a. Hispanic/Latino(a) O 

b. Black, non-Latino(a) O 

c. White, non-Latino(a) O 

d. Native American or Alaskan Native . . . . O 

e. Asian or Pacific Islander O 

f. Other O 

(write in) 

5. What language do the people in your home usually speak? (mark one) 

a. English O 

b. Spanish O 

c. Other O 

(write in) 

6. Are you eligible for free or reduced-price lunch? (mark one) 

Eligible for free lunch O 

Eligible for reduced-price lunch O 

Not eligible O 

I don't know O 



11. The next set of questions ask you to think about your experience this year in an 
Expeditionary Learning/Outward Bound School. 

7. Are you new to this school this year? 

Yes O (If yes, go to Q. 8) 

No O (If no, skip to Q. 9) 

8. If you are new to this school, in what ways is this school different from your school last 
year? 



9. What I like most about school this year is: 



10. What I like least about school this year is: 



11. Something I thought I could not do, but tried this year is: 



12. The accomplishment that I am most proud of this year is: 



13. Subject(s) that I am not learning this year (but should be learning) are: 



ERIC 
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If you were in this school last year, are there things in the school that have changed? Please 
describe (for example, amount of work, teachers, opportunities to do work outside of school); 



Check the response that best describes how you think. 

Most of 

Always the time Sometimes Rarely Never 

My teachers expect a lot of work O O O O O 

from smdents in this school. 

Smdents in my class are involved O O O O O 

in the planning of expeditions. 

My teachers listen to what I have O O O O O 

to say. 

In my classes, the other smdents listen O O O O O 

to what I have to say. 

In my classes, discovering things on O O O O O 

our own is a big part of the way we 

learn. 

I work hard in this school. O O O O O 

I find the work in this school O O O O O 

interesting. 

Teachers encourage smdents to O O O O O 

redo work until it is as good as it 
can be. 

In this school I have opportunities O O O O O 

to pursue my own interests or ideas. 

We work in groups of 3 or more 

smdents at least once a week O O O O O 

When we work in groups, some O O O O O 

students try to take over. 

I feel bad if I let my group down. O O O O O 



Most of 

Always the time Sometimes Rarely Neyer 

27. My group lets me know if I do not O O O O O 
get my work done or try my best. 

28. My group works well together. O O O O O 

29. Working in a group slows me down. O O O O O 

30. I learn from the other students O O O O O 
when we work in groups. 

31. I am comfortable participating in O O O O O 
my group. 

32. I fit in well in this school. O O O O O 



IV. For each question, check the response that best indicates how much you agree with each 
statement, (mark one for each) 

Strongly I am in Strongly 

Agree Agree Between Disagree Disagree 



33. 


My classes help me to find out 
what my interests are. 


O 


o 




o 




O 


O 


34. 


How much I learn in this school 
depends a lot upon my own efforts. 


o 


o 




o 




O 


O 


35. 


My teachers encourage students 
to look at things from different 
points of yiew. 


o 


o 




o 




O 


O 


36. 


My teachers encourage students 

of different abilities to work together. 


o 


o 




o 




O 


O 


37. 


My teachers encourage respect for 
women/girls and men^oys of different 
cultural/ethnic/racial backgrounds. 


o 


o 




o 




O 


O 


38. 


This year, when I did not understand something in class: 


(mark one for each) 










Often 


Sometimes 




Neyer 








a. I tried to figure it out on my own. 

b. I asked the other students in my class. 

c. I asked my teachers to explain it. 


O 

o 
o 




0 
O 
0 




O 
O 
O 








d. Other (write in): 


o 




0 




O 
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V. 

39. 



40. 



a. 



b. 



c. 



e. 



h. 



Portfolio Assessment 

Are portfolio assessments of student work used in your classes? 

Yes o (If yes, go to Q. 40) 

No o (If no, skip to Q. 41) 

Could you describe how portfolios are used in your class? 

Always 

O 



Do you discuss the work you put in your portfolios 
with your teachers in conferences? 



Do you discuss standards for doing good work 

in your classes? O 

Do you spend time revising your work until it is as 

as good as you can make it? O 

Do you write or talk about what you did well and 

areas you need to work on? O 

Do you have opportunities to comment on the work 

of other smdents? O 

Do you explain the contents of your portfolio to your 
parents in teacher/parent conferences? O 

Do you think that using portfolios helps you to 

learn better? O 



Sometimes 

O 

O 

o 
o 



o 



o 



o 



Never 

O 

o 
o 
o 



o 



o 



o 



If you answered always or sometimes to Q. 40g, please give an example of ways in which using 
portfolios helps you to learn. 



I 
I 
I 
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VI. 

41. 



Please indicate how much expeditions iiave helped you 

I find that participating in expeditions has helped me: 



with the following: 



Not at Does not 







A lot 


Some 


A little 


All 


annlv 


a. 


find out ways of getting 
information that I need 


O 


o 


o 


. o 


o 


b. 


learn how to solve problems 


O 


o 


o 


o 


o 


c. 


learn how to make plans 


o 


o 


o 


o 


o 


d. 


learn how to organize my time 


o 


o 


o 


o 


o 


e. 


learn how to work with different 
types of people 


o 


o 


o 


o 


o 


f. 


use information I learned in 
my class 


o 


o 


o 


o 


o 


g- 


learn how to get to a place I 
have never been before 


o 


o 


o 


o 


o 


h. 


feel comfortable talking to adults 


o 


o 


o 


o 


o 


i. 


know my community better 


o 


o 


o 


o 


o 


j- 


prepare for city/state tests 
in reading 


o 


o 


o 


o 


o 


k. 


prepare for city/state tests 
in math 


o 


o 


o 


o 


o 


1. 


prepare for city/state tests 
in other subjects 


o 


o 


o 


o 


o 


m 


understand how school relates 
to the "real world" 


o 


o 


o 


o 


o 


n. 


feel comfortable meeting people 
I do not know 


o 


o 


o 


o 


o 


0. 


learn about something I did not 


o 


o 


o 


o 


o 



know about before 
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41. 



In what other ways has participating in expeditions helped you? 



42. Is there anything you would like to tell us about your experience at your Expeditionary 
Learning Outward Bound School? 
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National Alliance far Restructuring Education 

Strategic Planning far Continuous Improvement 
Feedback Form far School and Site Plans 



SCHOOL: 



SITE: 



School/Site Background and Situation Analysis 



STRONG CASE 

_ Shows Insightful, integrated and data- 
based grasp of key issues in student 
characteristics/performance, school culture 
and school/community compatibility. 



GOOD CASE 

Presents information about student 

characteristics/performance, school culture 
and school/community compatibility; some 
good insighits and some holes/problems in the 
analysis of these trends 

_ Reflection shows direction but not deep, 
. „^ . ,■ systemic Alliance-flavored perspective on real 

problems and their linl< to the common Alliance problems and their linl< to the common Alliance 



Reflection points to deep, systemic. 

Alliance-flavored perspective on real 



sgerxJa 

Self-evaluation of progress in meeting 

Alliance indicators of core commitment shows 
important progress and honest/powerful 
perspective on how core commitments can aid 
significant systemic reform in local setting, 
especially in relation to local key issues 
discussed In background analysis. 

COMMENTS AND SUGGESTIONS: 



agenda. 

— Self-evaluation of progress in meeting 
Alliance indicators of core commitment shows 
important activity yet a moderate sense of how 
commitments can aid significant, systemic 
reform in local setting especially in relation to 
local key issues discussed in background 
analysis. 



LIMITED CASE 

— Presents information (often fragmented) 
about student characteristics/performance, 
school culture and school/community 
compatibility 



— Reflection shows limited analyses/grasp of 
what these trends mean for Alliance-flavored 
perspective on real problems or implications 
for future reform agenda. 

— Self-evaluation of progress In meeting 
Alliance indicators of core commitment shows 
moderate/little activity and little sense of how 
core commitments are aiding local reform; 
connection of reform agenda to local key issues 
in background analysis Is often vague or 
misdirected. 
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Strategic Plan Feedback (Rubric) 



SCHOOL: SITE: 

II. School/Site Core Beliefs, Mission and Vision 



STRONG CASE 

Presents a Mission Statement that Is the 

essence of what the school/site wants for all 
students and the fundamental reforms that will 
help in get there. 



The Vision Is based on powerful Core 

Beliefs (Alliance-oriented) and reflect a deep 
understanding of each design task and how they 
fit together to enhance student performance and 
systemic reform. 

The Vision provides an extended, rich, 

background analysis-informed and Integrated 
view of what students will experience and the 
educational system be like-organized around 
the 5 design task. 



GOOD CASE 

Presents a Mission statement that is good 

but not fully comprehensive, bold nor 
Alliance-centered around high performance 
standards for all students and the fundamental 
reform that will help the site/school get there. 

The Core Beliefs of the Alliance may be 

stated but not fully integrated into the local 
vision. 



The Vision has a general connection to the 

background analysis; the Vision Is organized 
around the 5 design tasks and shows moderate 
understanding of what the design tasks would 
look like when fully Implemented; the Vision 
also has significant holes, poorly developed 
areas or limited integration across design; the 
Vision has promise for helping students reach 
high performance and achieving systemic 
reform, but considerable work needs to be done 
in dfiveloping this vision. 



LIMITED CASE 

Presents no Mission Statement or one that 

does not reflect what the school/site wants for 
all students and how to get there. 



The Core Beliefs are not stated or are 

treated superficially. 



The Vision Is not linked to the 

site/school's background analysis and is not 
very strong-too vague/Idealistic, quite at 
odds with the Alliance's sense of reform 
priorities, or Is fragmented/Incremental; 
there Is little understanding of what the design 
tasks would look like when implemented In the 
site/school and how they fit together to enhance 
student performance and systemic reform. 



COMMENTS AND SUGGESTIONS: 
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Strategic Plan Feedback (Rubric) 

SCHOOL: 

III. Desired Results 



STRONG CASE 

Has clear/focused results indicators for 

student performance that fit with the Alliance 
view of reform; offers creative/extensive 
ways to use the 14 common vital signs that are 
relevant to local setting. 



_ Has generated thoughtful/exciting 
additional indicators of student performance 
and systemic reform. 



Shows strong evidence of 

capability/interest In using all results 
indicators to drive/refine reform efforts. 



GOOD CASE 

_ Shows good evidence that the 7 Common 
Student Performance Indicators have been 
internalized and will be used at the site/school 
but the use seems mechanical. 



Other indicators are OK but not creative 

nor powerful in focusing on high student 
performance or systemic reform. 



Shows some evidence of capacity/interest 

in using all indicators to drive/refine reform 
efforts. 



LIMITED CASE 

Has little sense of relevant/powerful vital 

slgns--yet may reproduce the list of 7 
Common Vital Signs, but shows little sense of 
other important student performance outcomes 
or indicators of systemic reform success; does 
not connect the indicators to local context. 

May not include other indicators or may 

have confused change process/task completion 
indicators with outcome indicators (the desired 
results). 

Shows little/no evidence of 

capacity/interest In using all indicators to 
drive/refine the standards-driven 
students/systemic reform. 



COMMENTS AND SUGGESTIONS: 
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Strategic Plan Feedback (Rubric) 

SCHOOL: SITE: 



IV. Design and Implementation 



STRONG CASE 

Has organized the design and implemen- 
tation around key components that are the 
heart of the vision/vital signs. 



Shows a powerful understanding of how to 

tackle ambitious, large scale change through 
analysis of present context, and the integration 
of strategies, governance, leadership and 
resources to achieve full implementation of the 
change. 

Puts capacity-building and systemic 

thinking/transformation at the heart of the 
design/implementation process. 

_ The culture of the site/school clearly 
supports extensive meaningful reform -- the 
plan has Integrated strategies to build school 
culture. 



GOOD CASE 

Has identified some promising 

design/implementation components but these 
are not fully integrated into the vision/vital 
signs. 



Shows mixed understanding of how to tackle 

ambitious, large scale change in connecting 
context, the integration of strategies, 
governance, leadership and resources; the 
design/implementation plan has some serious 
flaws yet considerable promise. 

The focus on capacity building and systemic 

thinking/transformation is a good beginning, 
but needs some improvement. 

The site/school culture only partially 

supports comprehensive reform •- limited 
attention to building a stron^ school culture . 



LIMITED CASE 

Shows little connection of the vision to the 

design/implementation and little sense of what 
the design is supposed to accompiish-resuits 
are not stated or are unclear/disconnected from 
the site/school vision or the Alliance Core 
Beliefs. 

The large design/Implementation shows 

littie sense of what it takes to tackle ambitious 
large scale change In connecting context, 
integration of strategies, governance, 
leadership and resources to achieve full 
implementation of the change. 

Little sense of capacity-building and 

systemic thinking/transformation as the heart 
of the design/Implementation process. 

The site/school culture is ignored or 

presents a significant limitation for the 
reform. 



COMMENTS AND SUGGESTIONS: 
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Strategic Plan Feedback (Rubric) 

SCHOOL: 



SITE: 



V. Implementation Timeline 



STRONG CASE 

Presents a timeline that Is organized 

around components that are strongly linked to 
desired results. 

Reflects deep insights about how to tackle 

large scale change; integrates strategies in 
feasible yet powerful way to reach quality 
results. 



GOOD CASE 

Presents a timeline that is organized 

around components that are somewhat linked to 
desired results. 

Shows some insight about the process of 

comprehensive reform-but misses key 
strategies or connections. 



LIMITED CASE 

Presents no timeline or one that may not be 

organized around components and desired 
results. 

Shows limited insight about the process of 

comprehensive reform. 



Provides excellent detail 

(what/when/who) about specific strategies 
and activities. 

Powerfully Integrates national reform 

agenda/tasks/core commitments with 
integrated local transformation. 



Shows how effort is continuously informed 

by results, and works towards continuous 
improvement. 



Provides detail (what/when/who) about 

specific strategies and activities but these lack 
robustness, feasibility, focus or Integration. 

Shows some integration of national and 

local reform agenda, tasks, and core 
commitments. 



Shows some monitoring of change 

process/results, but not a powerful, flexible, 
continuous process that will produce major 
results in a complex world. 



Provides no detail or the detail is mis- 
directed and fragmented. 



Shows little connection of national and local 

reform agendas-participation In national 
reform events are treated as isolated activities 
from the local reform agenda. 

Shows linear view of change that Is not 

especially flexible nor informed by results or 
efforts. 



COMMENTS AND SUGGESTIONS: 
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Strategic Plan Feedback (Rubric) 

SCHOOL: SITE: 



GOOD CASE LIMITED CASE 



VI. Collaborative Agreements 

STRONG CASE 

Shows collaborative agreements that 

engage significant key partners and 
stakeholders In systemic reform. 

Shows considerable Insight about the 

purpose, guiding principles and arrangements 
for this collaboration, and what It will take to 
make the collaboration successful and long- 
lasting. 



Shows collaborative agreements that 

involve key players (but perhaps not all needed 
key players). 

The Agreements are connected to the 

background analysis; the Agreements focus on 
meaningful pieces of reform (but perhaps not 
in a fully Integrated way) and on arrangements 
for reform-but need greater emphasis on 
powerful student performance for all students. 



Has no collaborative agreements or ones 

that show little sign of engaging key partners 
and stakeholders In systemic reform. 

The Collaborative Agreements show little 

sense of connection to the background analysis 
and little purpose or arrangements for 
systemic reform focused on powerful student 
performance for all students. 



ADDITIONAL COMMENTS: 



K. 1 



K. REFORM INTERVIEW SCHEDUX.E 

1. How would you describe the level at which the design elements are in 
place and observable at your school? If they are not yet well 
implemented, are they sufficiently well described? Are the resources — 
personnel, material, financial, scheduling--available for 
implementation? 

2. How would you describe the level at which students and others at 
your school have benefited so far from the design elements? What types 
of benefits are you seeing and how are you gauging them? 

3. What is your judgment about the possible success with which the 
design elements could be implemented next year at other, diverse school 
sites? What remains to be done before other sites should attempt to 
adopt the design? 

4. Please describe the nature and quality of any summer activities in 
which you participated? 

5. In general, hov/ would you now characterize your attitude tov/ard the 
NASDC program in your school? 

5. If the NASDC program were to discontinue in your school, what is the 
one thing for which it would be best remembered? 

7 . What is the one thing your school and the design team are not doing 
fully that it should do to help all students reach world-class knowledge 
and skill levels? 
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L. CONTEXT DATA WORKSHEET 
Student Population 







1994/95 


1995/96 


1996/97 


1997/98 


ENROLUtENT 












OENBER 


Male 












Female 










RACIAL/ ETHNIC STATUS 


American 
Ttidian/ A'laRlcan 
Native 












Aslan/Pacl£lc 
Islander 












African American 












White (not of 
Hispanic origin) 













Hispanic 












Other 










LIMITED ENGLISH PROFICIENT 


' ' -^^H i ..J ".i ♦ - 










FREE/REDUCED PRICE MEALS 












CHAPTER 1 












SPECIAL EDUCATION 












QIFTED/TALENTED 












MOBILITY 












STANDARDIZED TEST DATA (describe 
battery, form, score scale) 


Orade 












Grade 












Grade 











CONTEXT DATA- -SCHOOL CHARACTERISTICS 







1994/95 


1995/96 


1996/97 


1997/98 


STAFFING LEVELS 


Instmictlonal Staff 












Administrative Staff 










INSTRUCTIONAL TIME 












BUDGET INFORMATION 


Federal Moneys 












District Funds 












Grant and Contract 
Funds 












PTA and Other 
Fimdralsing Moneys 












Other Funds 
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Example De£inltion8 £or Context Data: 

1. Enro.llment--Nxjinber of students enrolled on 9/30. 

2. Student population characteristics--Number and percent of students (on 
9/30 or average daily during the official school year) disaggregated by 
gender, race, language proficiency, free/reduced price meals. Chapter 1, special 
education, and talented/gifted; where applicable, the following definitions may be 
used for disaggregation: 

Gender--male/ female 

Race- -American Indian/Alaskan Native, Asian/Pacific Islander, African 
American, White (not of Hispanic origin) , Hispanic, other (census 
categories) 

Limited English prof icient--have primary or home language other than 
standard English and have limited or no age-appropriate ability to 
understand, speak, read or write English 

Free/reduced price meals--meet family size and income guidelines (US 
Department of Agriculture) for free/reduced price meals 

Chapter l--receive services funded in whole or part by Chapter 1, ESEA 

Special education--students with learning or physical disabilities who 
have current Individualized Education Programs and are served by the system 

Gifted and talented- -are identified as academically gifted and/or talented 
and receive services /programs funded by the system 

3. Mobility- -number and percent (of enrollment) of students (1) entering the 
school after 9/30, and (2) transferring or dropping out after 9/30 and 
before 6/1. 

4. Norm- or criterion-referenced test data (if available from an ongoing 
program) --summaries of standardized test data reported as percentiles, 
stanines, normal curve equivalents, grade equivalents, or standard- or 
scale-based scores (include descriptions of scale or rubric definitions) 

5. Staffing levels--number and percent (of enrollment) of instructional 
staff (staff who perform professional activities related to teaching 
students) and professional support staff (staff who provide auxiliary 
services for students or the program, including librarians, counselors, 
principals, administrative assistants, etc.). 

6. Instructional time--average total time per day spent on instructinal activities 
and days of instruction per year. 

7. Budget information-- funds from the district (per pupil expenditures and 
other district-provided moneys). Chapter 1, Chapter 2, Goals 2000, grant, 
and other funds, PTA and other fund-raising moneys. 
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